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(57) In case continuous reproduction Is commanded 
from a first AV stream to a second AV stream, a third AV 
stream, made up of a preset portion of the first AV 
stream and a preset portion of the second AV stream, 
Is generated. The third AV stream Is reproduced when 
reproduction is switched from the first AV stream to the 
second AV stream. As the infomiation pertinent to the 



third AV stream, the address information of a source 
packet of the first AV stream at a timing of switching from 
the first AV stream to the third AV stream and the ad- 
dress infomnation of a source packet of the second AV 
stream at a timing of switching from the third AV stream 
to the second AV stream, are generated. This enables 
reproduction such as to maintain continuity between 
separately recorded AV streams. . 
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Description 

Technical Field 

5 [0001 ] This invention relates to an infomnation processing method and apparatus, a program, and a recording medium 
and, more particularly, to an Information processing method and apparatus, a program and a recording medium, con- 
figured for maintaining continuity of moving pictures in a reproducing domain. 

Background Art 

10 

[0002] Recently, a variety of types of optica! discs have been proposed as a recording medium that can be removed 
from a recording apparatus. These recordable optical discs have been proposed as a large capacity medium of several 
GBs and are thought to be promising as a medium for recording AV (audio visual) signals, such as video signals. 
Among the digital AV signal sources (supply sources), to be recorded on this recordable optical disc, there are CS 
IS digital satellite broadcast and BS digital broadcast. Additionally, the ground wave television broadcast of the digital 
system has also been proposed for future use. 

[0003] The digital video signals, supplied from these sources, are routinely compressed under the MPEG (Moving 
Picture Experts Group) 2 system. In a recording apparatus, a recording rate proper to the apparatus is set. If digital 
video signals of the digital broadcast are recorded In the conventional Image storage mediums for domestic use, digital 
20 video signals are first decoded and subsequently bandwidth-limited for recording. In the case of the digital recording 
system, including, of course, the MPEG1 Video, MPEG2 video and The present invention provides an DV systems, 
digital video signals are first decoded and subsequently re-encoded in accordance with an encoding system for the 
recording rate proper to the apparatus for recording subsequently. 

[0004] However, this recording system, in which the supplied bitstream is decoded once and subsequently band- 
25 width-limited and re-encoded prior to recording, suffers from deteriorated picture quality. If. in recording compressed 
video digital signals, the transmission rate of input digital signals is less than the recording rate for the recording and/ 
or reproducing apparatus, the method of directly recording the supplied bitstream without decoding or re-encoding 
suffers from deterioration in the picture quality only to the least extent. However, if the transmission rate of the input 
digital signals exceeds the recording rate of the recording and/or reproducing apparatus, it is Indeed necessary to re- 
30 encode the bitstream and to record the so-re-encoded bitstream, so that, after decoding in the recording and/or repro- 
ducing apparatus, the transmission rate will be not higher than the upper limit of the disc recording rate. 
[0005] If the bitstream is transmitted in a variable rate system in which the bit rate of the input digital signal is increased 
or decreased with time, the capacity of the recording medium can be exploited less wastefully in the case of a disc 
recording apparatus adapted for transiently storing data in a buffer and for recording the data In a burst fashion than 
35 in the case of a tape recording system having a fixed recording rate imposed by the fixed rpm of the rotary head. 

[0006] Thus, It may be predicted that, in the near future when the digital broadcast is to become the mainstream, an 
Increasing demand will be raised for a recording and/or reproducing apparatus in which broadcast signals are recorded 
as digital signals, without decoding or re-encoding, as in a data streamer, and in which a disc is used as a recording 
medium. 

40 [0007] In reproducing data recorded on a recording medium In the above-described recording apparatus, there is 
known so-called skip reproduction in which reproduction is continued up to a preset picture and a picture temporally 
spaced apart from the preset picture is reproduced next. This skip reproduction has a drawback that temporal continuity 
Is lost in the reproduced pictures. 

45 Disclosure of the Invention 

[0008] It is therefore an object of the present invention to enable reproduction such as to maintain continuity of moving 
pictures in the playback domain. 

[0009] The present invention provides an information processing apparatus including generating means for gener- 
50 ating, in case continuous reproduction from a first AV stream to a second AV stream is commanded, a third AV stream 
made up of a preset portion of the first AV stream and a preset portion of the second AV stream, the third AV stream 
being reproduced when reproduction is switched from the first AV stream to the second AV stream, and the address 
information, as the information pertinent to the third AV stream, the address information being made up of the infonmation 
on an address of a source packet of the first AV stream at a timing of switching of reproduction from the first AV stream 
55 to the third AV stream, and of the information on the address of a source packet of the second AV stream at a timing 
of switching of reproduction from the third AV stream to the second AV stream, and recording means for recording the 
third AV stream and the address information, as generated by the generating means. 

[001 0] Preferably, an arrival time stamp of the source packet of the first AV stream included in the address infonmation 
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generated by the generating means, and an arrival time stamp of a source packet located at a leading end of the third 
AV stream, are continuous to each other, and an arrival time stamp of the source packet of the second AV stream 
included in the address infonmation generated by the generating means and an arrival time stamp of a source packet 
located at a trailing end of the third AV stream are continuous to each other. 
5 [0011] Preferably, a sole discontinuous point exists in the arrival time stamp of the source packet in the third AV 
stream. 

[0012] Preferably, the address is determined so that a data portion of the AV stream previous to a source packet 
specified by the information on the address of the source packet of the first AV stream contained in the address infor- 
mation generated by the generating means will be located in a continuous area of not less than a preset size on a 
10 recording medium. 

[0013] Preferably, the address is detemiined so that a data portion of the AV stream subsequent to a source packet 
specified by the information on the address of the source packet of the second AV stream contained in the address 
infomnation generated by the generating means will be located in a continuous area of not less than a preset size on 
a recording medium. 

IS [0014] Preferably, the third AV stream is generated so that the third AV stream will be located in a continuous area 
of not less than a preset size on the recording medium. 

[0015] The present invention also provides an infonnation generating method including a step of generating, in case 
continuous reproduction from a first AV stream to a second AV stream is commanded, a third AV stream made up of 
a preset portion of the first AV stream and a preset portion of the second AV stream, the third AV stream being repro- 

20 duced when reproduction is switched from the first AV stream to the second AV stream, and a step of generating the 
address infonnation, as the information pertinent to the third AV stream, the address infomnation being made up of the 
infonnation on an address of a source packet of the first AV stream at a timing of switching of reproduction from the 
first AV stream to the third AV stream, and of the infonnation on the address of a source packet of the second AV 
stream at a timing of switching of reproduction from the third AV stream to the second AV stream. 

25 [0016] The present invention also provides a recording medium having recorded thereon a computer-readable pro- 
gram, in which the program includes a step of generating, in case continuous reproduction from a first AV stream to a 
second AV stream is commanded, a third AV stream made up of a preset portion of the first AV stream and a preset 
portion of the second AV stream, the third AV stream being reproduced when reproduction is switched from the first 
AV stream to the second AV stream, and a step of generating the address information, as the information pertinent to 

30 the third AV stream, the address infonnation being made up of the information on an address of a source packet of 
the first AV stream at a timing of switching of reproduction from the first AV stream to the third AV stream, and of the 
infonnation on the address of a source packet of the second AV stream at a timing of switching of reproduction from 
the third AV stream to the second AV stream. 

[001 7] The present invention also provides a program for having a computer execute a program, in which the program 
35 includes a step of generating, in case continuous reproduction from a first AV stream to a second AV stream is com- 
manded, a third AV stream made up of a preset portion of the first AV stream and a preset portion of the second AV 
stream, the third AV stream being reproduced when reproduction is switched from the first AV stream to the second 
AV stream, and a step of generating the address information, as the information pertinent to the third AV stream, the 
address infomiation being made up of the information on an address of a source packet of the first AV stream at a 
40 timing of switching of reproduction from the first AV stream to the third AV stream, and of the information on the address 
of a source packet of the second AV stream at a timing of switching of reproduction from the third AV stream to the 
second AV stream. 

[0018] The present invention also provides an information processing apparatus including first readout means for 
reading out a first AV stream, a second AV stream or a third AV stream from a recording medium, second readout 

^5 means for reading out, as the information pertinent to the third AV stream, the information on an address of a source 
packet of the first AV stream at a timing of switching of reproduction from the first AV stream to the third AV stream, 
and of the infonnation on the address of a source packet of the second AV stream at a timing of switching of reproduction 
from the third AV stream to the second AV stream, and reproducing means for performing reproduction as reproduction 
is switched from the first AV stream read out by the first readout means to the third AV stream and from the third AV 

50 stream to the second AV stream, based on the information pertinent to the third AV stream read out by the second 
readout means. 

[0019] The present invention also provides an information processing method including a first readout controlling 
step of reading out a first AV stream, a second AV stream or a third AV stream from a recording medium, a second 
readout controlling step of reading out, as the infonnation pertinent to the third AV stream, the infomnation on an address 
55 of a source packet of the first AV stream at a timing of switching of reproduction from the first AV stream to the third 
AV stream, and of the information on the address of a source packet of the second AV stream at a timing of switching 
of reproduction from the third AV stream to the second AV stream, and a reproducing step of perfomning reproduction 
as reproduction is switched from the first AV stream read out by the first readout means to the third AV stream and 
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from the third AV stream to the second AV stream, based on the information pertinent to the third AV stream read out 
by the second readout means. 

[0020] The present Invention also provides a recording medium having recorded thereon a computer-readable pro- 
gram, in which the program includes a first readout controlling step of reading out a first AV stream, a second AV stream 

5 or a third AV stream from a recording medium, a second readout controlling step of reading out, as the information 
pertinent to the third AV stream, the information on an address of a source packet of the first AV stream at a timing of 
switching of reproduction from the first AV stream to the third AV stream, and of the information on the address of a 
source packet of the second AV stream at a timing of switching of reproduction from the third AV stream to the second 
AV stream, and a reproducing step of performing reproduction as reproduction is switched from the first AV stream 

10 read out by the first readout means to the third AV stream and from the third AV stream to the second AV stream, based 
on the Information pertinent to the third AV stream read out by the second readout means. 

[0021] The present invention also provides a program for having a computer execute a program, In which the program 
Includes a first readout controlling step of reading out a first AV stream, a second AV stream or a third AV stream from 
a recording medium, a second readout controlling step of reading out, as the information pertinent to the third AV 

15 stream, the information on an address of a source packet of the first AV stream at a timing of switching of reproduction 
from the first AV stream to the third AV stream, and of the information on the address of a source packet of the second 
AV stream at a timing of switching of reproduction from the third AV stream to the second AV stream, and a reproducing 
step of perf onning reproduction as reproduction is switched from the first AV stream read out by the first readout means 
to the third AV stream and from the third AV stream to the second AV stream, based on the Information pertinent to 

20 the third AV stream read out by the second readout means. 

[0022] The present invention also provides a recording medium having recorded thereon the address information 
including, In case continuous reproduction from a first AV stream to a second AV stream Is commanded, a third AV 
stream made up of a preset portion of the first AV stream and a preset portion of the second AV stream, the third AV 
stream being reproduced when reproduction is switched from the first AV stream to the second AV stream, and the 

25 address infonnation, as the information pertinent to the third AV stream, the address infomiation being made up of the 
Infomriatlon on an address of a source packet of the first AV stream at a timing of switching of reproduction from the 
first AV stream to the third AV stream, and of the Information on the address of a source packet of the second AV 
stream at a timing of switching of reproduction from the third AV stream to the second AV stream. 
[0023] In the infonnation processing method and apparatus, and the program, according to the present Invention, if 

30 the it is commanded to perform reproduction continuously from the first AV stream to the second AV stream, there is 
generated a third AV stream made up of a preset portion of the first AV stream and a preset portion of the second AV 
stream and which is reproduced when reproduction is switched from the first AV stream to the second AV stream, while 
there Is generated, as the information pertinent to the third AV stream, the address information made up of the infor- 
mation on an address of a source packet of the first AV stream at a timing of switching of reproduction from the first 

35 AV stream to the third AV stream, and of the Information on the address of a source packet of the second AV stream 
at a timing of switching of reproduction from the third AV stream to the second AV stream. 

[0024] In the infomiation processing method and apparatus, and the program, according to the present Invention, a 
first AV stream, a second AV stream or a third AV stream is read out from a recording medium, the address infonnation 
made up of the Information on an address of a source packet of the first AV stream at a timing of switching of reproduction 

40 from the first AV stream to the third AV stream, and the information on the address of a source packet of the second 
AV stream at a timing of switching of reproduction from the third AV stream to the second AV stream, Is read out from 
the recording medium as the information pertinent to the third AV stream, and reproduction is switched from the first 
AV stream to the third AV stream and from the third AV stream to the second AV stream, as reproduction proceeds, 
based on the read-out information pertinent to the third AV stream. 

45 [0025] Other objects, features and advantages of the present invention will become more apparent from reading the 
embodiments of the present invention as shown In the drawings. 

Brief Description of the Drawings 

50 [0026] 

Flg.1 shows a configuration of an embodiment of a recording and/or reproducing apparatus according to the present 
invention. 

Fig.2 illustrates the data format of data recorded on a recording medium by a recording and/or reproducing appa- 
55 ratus 1 . 

Flg.3 Illustrates Real PlayLlst and Virtual Play List. 

Figs.4A, 4B and 4C illustrate the creation of the Real PlayLlst. 

Figs.5A, 5B and 5C illustrate deletion of the Real PlayLlst. 
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Figs.6A and 6B illustrate assemble editing. 
Fig. 7 illustrates provision of a sub path in the Virtual PlayList. 
Fig. 8 illustrates the changing of the playback sequence of the PlayList. 
Fig.9 Illustrates a mark on the PlayList and a mark on the Clip. 
5 Fig.1 0 illustrates a menu thumbnail. 

Fig. 11 illustrates mark added to the PlayList. 
Fig. 12 Illustrates a mark added to the Clip. 

Fig.1 3 illustrates the relation between the PlayList, Clip and the thumbnail file. 

Fig. 14 illustrates a directory structure. 
10 Fig.1 5 illustrates a syntax of Infr.dvr. 

Fig.1 6 shows a syntax of DVRVolume. 

Fig.1 7 shows a syntax of ResumeVolume. 

Fig.1 8 shows a syntax of UlApplnfo Volume. 

Flg.1 9 shows a table of character set values. 
15 Fig.20 shows a syntax of TableOf PlayList. 

Fig.21 shows another syntax of TableOfPlayList. 

Fig.22 shows a syntax of the fy/lakersPrivateData. 

Fig.23 shows a syntax of xxxx.rpis and yyyy.vpls. 

Figs.24A to 24C illustrate the PlayList. 
20 Fig.25 shows a syntax of PlayList. 

Fig.26 shows a table of PlayList_type. 

Fig.27 shows a syntax of UlApplnfoPlayList. 

Figs.28A to 28C illustrate flags in the UlApplnfoPlayList syntax shown in Fig.27. 

Flg.29 illustrates a Playltem. 
25 Fig.30 illustrates a Playltem. 

Fig.31 illustrates a Playltem. 

Fig.32 shows a syntax of the Playltem. 

Fig.33 illustrates IN-time. 

Fig.34 illustrates OUT-time. 
30 Fig. 35 shows a table of Connection_Conditron. 

Figs.36A to 36D illustrate Connection_Condition. 

Fig.37 illustrates BridgeSequencelnfo. 

Fig.38 shows a syntax of BridgeSequencelnfo. 

Flg.39 illustrates SubPlayltem. 
35 Fig.40 shows a syntax of SubPlayltem. 

Fig.41 shows a table of Mark_type. 

Fig.42 shows a syntax of PlayListMark. 

Fig.43 shows a table of Mari<_type. 

Fig.44 Illustrates Mark_time_stamp. 
40 Fig.45 shows a syntax of zzzzz.clip. 

Fig.46 shows a syntax of Cliplnfo. 

Fig.47 shows a table of Clip_stream_type. 

Fig.48 illustrates bffset_SPN. 

Flg.49 illustrates offset^SPN. 
45 Figs.SOA, 508 illustrate the STC domain. 

Fig.51 illustrates STCJnfo. 

Fig.52 shows a syntax of STC_lnfo. 

Fig.53 illustrates Programlnfo. 

Fig.54 shows a syntax of Programlnfo. 
50 Fig.55 shows a syntax of VideoCondinglnfo. 

Fig. 5 6 shows a table of Video_format. 

Fig.57 shows a table of frame_rate. 

Fig.58 shows a table of display_aspect_ratio. 

Fig. 59 shows a syntax of AudioCondinglnfo. 
55 Fig.60 shows a table of audio_coding. 

Fig.61 shows a table of audio_component_type. 

Fig.62 shows a table of sampling^frequency. 

Fig.63 illustrates CPI. 
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Fig.64 illustrates CPI. 

Fig.65 shows a syntax of CPL 

Fig.66 shows a table of CPLtype. 

Fig,67 illustrates video EP_map. 
5 Fig.68 illustrates EP_map. 

Fig.69 illustrates EP_map. 

Fig.70 shows a syntax of EP_map. 

Fig.71 shows a table of EP_typevalues. 

Fig.72 shows a syntax of EP_map_for_one_stream_PID. 
10 Fig.73 illustrates TU.nnap. 

Fig.74 shows a syntax of TU_map. 

Fig.75 shows a syntax of ClipMark. 

Fig.76 shows a table of Mark_type. 

Fig.77 shows a table of Mark_type_stamp. 
15 Fig.78 shows a syntax of menu.thmb and marl<.thmb. 

Fig.79 shows the syntax of thumbnail. 

Fig. 80 shows a table of thumbnail _picture_fomnat. 

Figs.81 A and 81 Billustrate tn_block, 

Fig.82 illustrates a structure of a transport stream of DVR MPEG2. 
20 Fig.83 shows a recorder model of a transport stream of DVR MPEG2. 

Fig.84 shows a player model of a transport stream of DVR MPEG2. 

Fig.85 shows the syntax of a source packet. 

Fig.86 shows the syntax of TP_extra_header. 

Fig.87 shows a table of a copy pennission indicator. 
25 Fig.88 illustrates seamless connection. 

Fig.89 illustrates seamless connection. 

Fig.90 illustrates seamless connection. 

Fig.91 illustrates seamless connection. 

Fig.92 illustrates seamless connection. 
30 Fig.93 illustrates audio overlap. 

Fig.94 illustrates seamless connection employing BridgeSequence. 

Fig.95 illustrates seamless connection not employing BridgeSequence. 

Fig,96 shows a DVR STD model. 

Fig.97 is a timing chart for decoding and display. 
35 Fig.98 shows another syntax of BridgeSequencelnfo. 

Fig.99 illustrates Bridge_CIip when two Playltems are seamlessly connected. 

Fig. 100 shows a syntax of a Clip Infonnation file. 

Fig.1 01 shows a syntax of a Cliplnfo of the Clip Infonnation file of Fig.100. 

Fig.1 02 shows a syntax of a Sequencelnfo of the Clip Infonnation file of Fig.100. 
40 Figs.1 03A and 1 03B illustrate database change in case stream data of the Clip AV stream file is partially erased. 

Fig.1 04 is a flowchart for illustrating the preparation of a RealPlayList. 

Fig.1 05 is a flowchart for illustrating the fomiulation of a Virtual PlayList. 

Fig.1 06 is a flowchart for illustrating the fomnulation of a bridge sequence. 

Fig.1 07 is a flowchart for illustrating the reproduction of PlayList. 
45 Fig.1 08 illustrates a medium. 

Best Mode for Carrying out the Invention 

[0027] Referring to the drawings, present embodiment of the present invention will be explained in detail. Fig.1 shows 
50 a typical inner structure of a recording and/or reproducing apparatus 1 embodying the present invention. First, the 
structure of a recording unit 2, configured for recording signals input from outside, is explained. The recording and/or 
reproducing apparatus 1 Is configured for being fed with and recording analog or digital data. 

[0028] Analog video signals and analog audio signals are fed to temriinals 11.12. respectively The video signals, 
input to the temiinal 11. are output to an analysis unit 14 and to an AV encoder 15. The audio signals, input to the 
55 terminal 12. are output to the analysis unit 14 and to the AV encoder 15. The analysis unit 14 extracts feature points, 
such as scene changes, from the input video and audio signals. 

[0029] The AV encoder 15 encodes input video and audio signal to output the system information (S), such as an 
encoded video stream (V). an encoded audio stream (A) and AV synchronization, to a multiplexer 16, 
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[0030] The encoded video stream is a video stream encoded e.g., with the MPEG (Moving Picture Expert Group) 2 
system, whilst the encoded audio stream is an audio stream encoded in accordance with the MPEG1 system, with the 
encoded audio stream being e.g., an audio stream encoded in e.g., the MPEG1 system or an audio stream encoded 
in accordance with the Dolby ACS (trademak) system. The multiplexer 1 6 multiplexes the input video and audio streams, 
5 based on the input system infonmation, to output a multiplexed stream through a switch 17 to a multiplexed stream 
analysis unit 18 and to a source packetizer 19. 

[0031] The multiplexed stream is e.g., an MPEG-2 transport stream or an MPEG2 program stream. The source 
packetizer 19 encodes the input multiplexed stream into an AV stream composed of source packets in accordance 
with an application fomnat of a recording medium 100 on which to record the stream. The AV stream is processed in 
10 ECC (error correction and coding) unit 20 and a modulation unit 21 with appendage of ECO codes and with modulation, 
before being output to a write unit 22. which then writes (records) an AV stream file based on a control signals output 
by the controller 23. 

[0032] The transport stream, such as digital television broadcast, input from a digital interface or a digital television 
tuner, is input to a terminal 1 3. There are two recording systems for recording the transport stream input to the tenminal 
IS 13, one being a transparent recording system and the other being a system in which recording is preceded by re- 
encoding aimed to lower e.g., the recording bit rate. The recording system command infomnation is input from a terminal 
24 as a user interface to a controller 23. 

[0033] In the transparent recording of the input transport stream, a transport stream, input to a terminal 1 3, is output 
through a switch 1 7 to a multiplexed stream analysis unit 1 8 and to the source packetizer 1 9. The ensuing processing 
20 of recording an AV stream on a recording medium is the same as that of encoding and recording analog input audio 
and video signals, as described above, and hence is not explained here for simplicity. 

[0034] If the input transport stream is re-encoded and subsequently recorded, the transport stream, input to the 
terminal 13. is fed to a demultiplexer 26, which demultiplexes the input transport stream to extract a video stream (V), 
an audio stream (A) and the system infomnation (S). 

25 [0035] Of the stream (infomnation), as extracted by the demultiplexer 26. the video stream is output to an audio 
decoder 27, whilst the audio stream and the system Infomnation are output to the multiplexer 16. The audio decoder 
27 decodes the input transport stream to output the encoded video stream (V) to the multiplexer 16. 
[0036] The audio stream and the system information, output from the demultiplexer 26 and input to the multiplexer 
16, and the video stream, output by the AV encoder 15, are multiplexed, based on the input system information, and 

30 output to the multiplexed stream analysis unit 1 8 and to the source packetizer 1 9 through switch 1 7, as a multiplexed 
stream. The ensuing processing of recording an AV stream on a recording medium is the same as that of encoding 
and recording analog input audio and video signals, as described above, and hence is not explained here for simplicity. 
[0037] The recording and/or reproducing apparatus 1 of the present embodiment records a file of the AV stream on 
the recording medium 100, while also recording the application database infomnation which accounts for the file. The 

35 input information to the controller 23 is the feature infomnation for the moving picture from the analysis unit 14, the 
feature information of the AV stream from the multiplexed stream analysis unit 1 8 and the user command infomnation 
input at a terminal 24. 

[0038] The feature infomnation of the moving picture, supplied from the analysis unit 1 4, is generated by the analysis 
unit 14 when the AV encoder 15 encodes video signals. The analysis unit 14 analyzes the contents of the input video 
40 and audio signals to generate the information pertinent to the pictures characteristic of the input moving picture signals 
(clip mark). This information is the infomnation indicating a picture of characteristic clip mark points, such as program 
start points, scene change points, CM commercial start and end points, title or telop in input video signals, and also 
includes a thumbnail of the picture and the infomnation pertinent to stereo/monaural switching points and muted portions 
of audio signals. 

45 [0039] The above picture indicating infomnation is fed through controller 23 to the multiplexer 1 6. When multiplexing 
a encoded picture specified as clip mark by the controller 23, the multiplexer 16 retums the information for specifying 
the encoded picture on the AV stream to the controller 23. Specifically, this information is the PTS (presentation time 
stamp) of a picture or the address information on the AV stream of an encoded version of the picture. The controller 
23 stores the sort of feature pictures and the infomnation for specifying the encoded picture on the AV stream in asso- 

50 ciation with each other. 

[0040] The feature infonnation of the AV stream from the multiplexed stream analysis unit 18 is the information 
pertinent to the encoding information of the AV stream to be recorded, and is recorded by an analysis unit 18. For 
example, the feature infomnation includes the time stamp and address infomnation of the l-picture in the AV stream, 
discontinuous point infonnation of system time clocks, encoding parameters of the AV stream and change point Infor- 
55 mation of the encoding parameters in the AV stream. When transparently recording the transport stream, input from 
the terminal 13, the multiplexed stream analysis unit 18 detects the picture of the aforementioned clip mark, from the 
input transport stream, and generates the information for specifying a picture designated by the clip mark and its type. 
[0041] The user designation infomnation from the terminal 24 is the infomnation specifying the playback domain. 
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designated by the user, character letters for explaining the contents of the playback domain, or the infomnation such 
as bookmarks or resuming points set by the user for his or her favorite scene. 

[0042] Based on the aforementioned input information, the controller 23 creates a database of the AV stream (Clip), 
a database of a group (PlayList) of playback domains (Playltem) of the AV stream, management infomiation of the 
recorded contents of the recording medium 100 (info.dvr) and the information on thumbnail pictures. Similarly to the 
AV stream, the application database information, constructed from the above infomiation, is processed in the ECC unit 
20 and the modulation unit 21 and input to the write unit 22, which then records a database file on the recording medium 
100. 

[0043] The above-described application database infonnation will be explained subsequently in detail. 
[0044] When the AV stream file recorded on the recording medium 100 (files of picture data and speech data) and 
the application database Infonnation, thus recorded on the recording medium 100, are reproduced by a reproducing 
unit 3, the controller 23 first commands a readout unit 28 to read out the application database infonnation from the 
recording medium 1 00. The readout unit 28 reads out the application database information from the recording medium 
1 00, which then reads out the application database infomnation from the recording medium 1 00 to send the application 
database information through demodulation and error correction processing by a demodulating unit 29 and an ECC 
decoder 30 to the controller 23. 

[0045] Based on the application database infonnation, the controller 23 outputs a list of PlayList recorded on the 
recording medium 1 00 to a user interface of the tenninal 24. The user selects the PlayList, desired to be reproduced, 
from the list of PlayLists. The information pertinent to PlayList, specified to be reproduced, is input to the controller 23. 
The controller 23 commands the readout unit 28 to read out the AV stream file necessary in reproducing the PlayList. 
In accordance with the command, the readout unit 28 reads out the con-esponding AV stream from the recording 
medium 100 to output the read-out AV stream to the demodulating unit 29. The AV stream, thus input to the demodu- 
lating unit 29, is demodulated by preset processing and output through the processing by the ECC decoder 30 to a 
source depacketizer 31 . 

[0046] The source depacketizer 31 converts the AV stream of the application fomnat, read out from the recording 
medium 100 and processed in a preset fashion, into a stream processable by the demultiplexer 26. The demultiplexer 
26 outputs the system infonnation (S), such as the video stream (V), audio stream (A) or the AV synchronization, 
forming the playback domain (Playltem) of the AV stream specified by the controller 23, to the audio decoder 27, which 
AV decoder 27 decodes the video stream and the audio stream to output the playback video signal and the playback 
audio signal to associated temninals 32, 33, respectively. 

[0047] If fed from the tenninal 24, as a user Interface, with the infonnation instructing random access playback or 
special playback, the controller 23 detemnines the readout position of the AV stream from the recording medium 1 00, 
based on the contents of the database (Clip) of the AV stream, to command the readout unit 28 to read out the AV 
stream. If the PlayList as selected by the user is to be reproduced as from a preset time point, the controller 23 com- 
mands the readout unit 28 to read out data from an l-picture having a time stamp closest to the specified time point. 
[0048] When the user has selected a certain clip mark from indexing points or scene change points for the program 
stored in the ClipMark in the Clip Information, as when the user selects a certain picture from a list of thumbnail pictures, 
as demonstrated on a user interface, of the indexing points or scene change points stored in the ClipMark, the controller 
23 determines the AV stream readout position from the recording medium 1 00 to command the readout unit 28 to read 
out the AV stream. That is, the controller 23 commands the readout unit 28 to read out data from an l-picture having 
an address closest to the address on the AV stream which has stored the picture selected by the user. The readout 
unit 28 reads out data from the specified address . The read-out data is processed by the demodulating unit 29, ECC 
decoder 30 and by the source packetlzer 19 so as to be supplied to the demultiplexer 26 and decoded by the audio 
decoder 27 to reproduce AV data Indicated by an address of the mark point picture. 

[0049] If the user has commanded fast f onward playback, the controller 23 commands the readout unit 28 to sequen- 
tially read out l-picture data in the AV stream in succession based on the database (Clip) of the AV stream. 
[0050] The readout unit 28 reads out data of the AV stream from a specified random access point. The so read-out 
data is reproduced through processing by various components on the downstream side. 

[0051] The case in which the user edits the AV stream recorded on the recording medium 100 Is now explained. If 
desired to specify a playback domain for the AV stream recorded on the recording medium 100, for example, if desired 
to create a playback route of reproducing a portion sung by a singer A from a song program A, and subsequently 
reproducing a portion sung by the same singer A from another song program B, the information pertinent to a beginning 
point (IN-point) and an end point (OUT-point) of the playback domain is input to the controller 23 from the tenninal as 
a user interface. The controller 23 creates a database of the group (PlayList) of playback domains (Playltem) of the 
AV streams. 

[0052] When the user desires to erase a portion of the AV stream recorded on the recording medium 1 00, the infor- 
mation pertinent to the IN-point and the OUT-point of the erasure domain is input to the controller 23. whfch then 
modifies the database of the PlayList so as to refer to only the needed AV streams. The controller 23 also commands 
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the write unit 22 to erase an unneeded stream portion of the AV stream. 

[0053] The case in which the user desires to specify playback domains of an AV stream recorded on the recording 
medium to create a new playback route, and to interconnect the respective playback domains in a seamless fashion, 
is now explained. In such case, the controller 23 creates a database of a group (PlayList) of the playback domains 
5 (Playltem) of the AV stream and undertakes to partially re-encode and re-multiplex the video stream in the vicinity of 
junction points of the playback domains. 

[0054] The picture infonnation at the IN-point and that at the OUT-point of a playback domain are inputfrom a terminal 
24 to a controller 23. The controller 23 commands the readout unit 28 to read out data needed to reproduce the pictures 
at the IN-point and at the OUT-point. The readout unit 28 reads out data from the recording medium 1 00. The data so 
10 read out is output through the demodulating unit 29, ECC decoder 30 and the source packetizer 1 9 to the demultiplexer 
26. 

[0055] The controller 23 analyzes data input to the demultiplexer 26 to determine the re-encoding method for the 
video stream (change of picture_coding_type and assignment of the quantity of encoding bits for re-encoding) and the 
re-multiplexing system to send the system to the AV encoder 15 and to the multiplexer 16. 

IS [0056] The demultiplexer 26 then separates the input stream into the video stream (V), audio stream (A) and the 
system information (S). The video stream may be classed into data input to the audio decoder 27 and data input to 
the multiplexer 16. The former is data needed for re-encoding, and is decoded by the audio decoder 27, with the 
decoded picture being then re-encoded by the AV encoder 15 and thereby caused to become a video stream. The 
latter data is data copied from an original stream without re-encoding. The audio stream and the system information 

20 are directly input to the multiplexer 1 6. 

[0057] Themultiplexer 16 multiplexes an input stream, based on the information input from the controller 23, to output 
a multiplexed stream, which is processed by the ECC unit 20 and the modulation unit 21 so as to be sent to the write 
unit 22. The write unit 22 records an AV stream on the recording medium 100 based on the control signals supplied 
from the controller 23. 

25 [0058] The application database information and the operation based on this information, such as playback and 
editing, are hereinafter explained. Fig.2 shows the structure of an application fonnat having two layers, that Is PlayList 
and Clip, for AV stream management. The Volume Infonnation manages all Clips and PlayLists in the disc. Here, one 
AV stream and the ancillary information thereof, paired together, is deemed to be an object, and is termed Clip. The 
AV stream file is termed a Clip AV stream file, with the ancillary information being termed the Clip Infonnation file. 

30 [0059] One Clip AV stream file stores data corresponding to an MPEG-2 transport stream arranged in a structure 
prescribed by the application format. By and large, a file is treated as a byte string. The contents of the Clip AV stream 
file are expanded on the time axis, with entry points in the Clip (l-picture) being mainly specified on the time basis. 
When a time stamp of an access point to a preset Clip is given, the Clip Infomnatlon file Is useful in finding the address 
infonnation at which to start data readout in the Clip AV stream file. 

35 [0060] Referring to Fig. 3, PlayList is now explained, which is provided for a user to select a playback domain desired 
to be viewed from the Clip and to edit the playback domain readily. One PlayList is a set of playback domains in the 
Clip. One playback domain in a preset Clip is termed Playltem and is represented by a pair of an IN-point and an OUT- 
point on the time axis. So, the PlayList is formed by a set of plural Playltems. 

[0061] The PlayList is classified into two types, one of which is Real PlayList and the other of which Is Virtual PlayList. 
40 The Real PlayList co-owns stream portions of the Clip it is referencing. That is, the Real PlayList takes up in the disc 
the data capacity corresponding to a stream portion of the Clip it is referencing and, when Real PlayList is erased, the 
data of the stream portion of the Clip it is referencing is also erased. 

[0062] The Virtual PlayList is not co-owning Clip data. Therefore, If the Virtual PlayList is changed or erased, the 

contents of the Clip are in no way changed. 
45 [0063] The editing of the Real Playlist is explained. Fig.4A shows creation of Real PlayList and, if the AV stream is 

recorded as a new Clip, the Real PlayList which references the entire Clip is a newly created operation. 

[0064] Flg.4B shows the division of the real PlayList, that is the operation of dividing the Real PlayList at a desired 

point to split the Real PlayList in two Real PlayLists. This division operation is performed when two programs are 

managed in one clip managed by a sole PlayList and when the user intends to re-register or re-record the programs 
50 as separate individual programs. This operation does not lead to alteration of the Clip contents, that is to division of 

the Clip Itself. 

[0065] Fig.4C shows the combining operation of the Real PlayList which is the operation of combining two Real 
PlayLists into one new Real PlayList. This combining operation is performed such as when the user desires to re- 
register two programs as a sole program. This operation does not lead to alteration of the Clip contents, that Is to 
55 combining the clip itself into one. 

[0066] Fig.SA shows deletion of the entire Real PlayList. If the operation of erasing the entire preset Real PlayList, 

the associated stream portion of the Clip referenced by the deleted Real PlayList is also deleted. 

[0067] Fig.SB shows partial deletion of the Real PlayList. If a desired portion of the Real PlayList is deleted, the 
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associated Playltem is altered to reference only the needed Clip stream portion. The corresponding stream portion of 
the Clip is deleted. 

[0068] Fig.SC shows the minimizing of the Real PlayList. It is an operation of causing the Playltem associated with 
the Real PlayList to reference only the stream portion of the Clip needed for Virtual PlayList. The corresponding stream 
portion of the Clip not needed for the Virtual PlayList is deleted. 

[0069] If the Real PlayList is changed by the above-described operation such that the stream portion of the Clip 
referenced by the Real PlayList is deleted, there is a possibility that the Virtual PlayList employing the deleted Clip is 
present such that problems may be produced in the Virtual PlayList due to the deleted Clip. 

[0070] In order to prevent this from occurring, such a message which runs: "If there exists the Virtual Play List ref- 
erencing the stream portion of the Clip the Real PlayList is referencing, and the Real PlayList is deleted, the Virtual 
PlayList itself is deleted - is it all right?" Is displayed for the user in response to the user's operation of deletion by way 
of conf Innation or alamiing, after which the processing for deletion is executed or cancelled subject to user's commands. 
Alternatively, the minimizing operation for the Real PlayList is performed in place of deleting the Virtual PlayLisL 
[0071] The operation for the Virtual PlayList is now explained. If an operation is performed for the Virtual PlayList, 
the contents of the Clip are not changed. Figs.6A and 6B show the assembling and editing (IN-GUT editing). It is an 
operation of creating Playltem of the playback domain the user has desired to view to create Virtual PlayList. The 
seamless connection between Playltems Is supported by the application format, as later explained. 
[0072] If there exist two Real PlayLists 1 , 2 and clips 1 , 2 associated with the respective Real PlayLists, the user 
specifies a preset domain in the Real PlayList 1 (domain from INI to OUT1 : Playlterri 1) as the playback domain, and 
also specifies, as the domain to be reproduced next, a preset domain in the Real PlayList 2 (domain from IN2 to OUT2: 
Playltem 2) as the playback domain, as shown in Fig.SA, a sole Virtual PlayList made up of Playltem 1 and the Play Item2 
Is prepared, as shown in Flg.6B. 

[0073] The re-edlting of the Virtual PlayList is now explained. The re-editing may be enumerated by alteration of IN- 
or OUT points In the Virtual PlayList, insertion or appendage of new Playltems to the Virtual PlayList and deletion of 
Playltems in the Virtual PlayList. The Virtual PlayList itself may also be deleted. 

[0074] Fig. 7 shows the audio dubbing (post recording) to the Virtual PlayList. It is an operation of registering the 
audio post recording to the Virtual PlayList as a sub path. This audio post recording is supported by the application 
software. An additional audio stream is added as a sub path to the AV stream of the main path of the Virtual PlayList. 
[0075] Common to the Real PlayList and the Virtual PlayList is an operation of changing (moving) the playback 
sequence of the PlayList shown in Fig.8. This operation is an alteration of the playback sequence of the PlayList In the 
disc (volume) and is supported by TableOfPlayList as defined In the application format, as will be explained subse- 
quently with reference to e.g., Fig.20. This operation does not lead to alteration of the Clip contents. 
[0076] The mark (Mark) is now explained. The mark is provided for specifying a highlight or characteristic time in the 
Clip and in the PlayList, as shown in Flg.9. The mark added to the Clip is temned the ClipMari<. The ClipMark is e.g., 
a program indexing point or a scene change point for specifying a characteristic scene ascribable to contents in the 
AV stream. The ClipMark is generated by e.g., the analysis unit 14 of Fig.1 . When the PlayList Is reproduced, the mark 
of the Clip referenced by the PlayList may be referenced and used. 

[0077] The mark appended to the PlayList is temned the PlayListMark (play list mark). The PlayListMark is e.g., a 
bookmark point or a resuming point as set by the user. The setting of the mari< to the Clip and to the PlayList is by 
adding a time stamp Indicating the mark time point to the mari< list. On the other hand, mark deletion is removing the 
time stamp of the mark from the mark list. Consequently, the AV stream is In no way changed by mark setting or by 
mark deletion. 

[0078] As another fonnat of the ClipMark, a picture referenced by the ClipMark may be specified on the address 
basis in the AV stream. Mark setting on the Clip is by adding the address basis information indicating the picture of the 
mark point to the mark list. On the other hand, mark deletion Is removing the address basis infonmatlon Indicating the 
mark point picture from the mark list. Consequently, the AV stream is In no way changed by mark setting or by mark 
deletion. 

[0079] A thumbnail is now explained. The thumbnail is a still picture added to the Volume, PlayList and Clip. There 
are two sorts of the thumbnail, one of them being a thumbnail as a representative picture indicating the contents. This 
is mainly used in a main picture in order for the user to select what the or she desired to view on acting on a cursor, 
not shown. Another sort of the thumbnail is a picture indicating a scene pointed by the mark. 

[0080] The Volume and the respective PlayLists need to own representative pictures. The representative pictures 
of the Volume are presupposed to be used for initially demonstrating a still picture representing the disc contents when 
the disc is set in position in the recording and/or reproducing apparatus 1 . It is noted that the disc means the recording 
medium 100 which is presupposed to be a of disc shape. The representative picture of the PlayList Is presupposed to 
be used as a still picture for representing PlayList contents. 

[0081] As the representative pteture of the PlayList, It may be contemplated to use the initial picture of the PlayList 
as the thumbnail (representative picture). However, the leading picture at the playback time of 0 is not necessarily an 
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PteVLW. TWO sons of the ffi.mbn.lls. ,hal Is .he »a,l » » '^T'^^'^J'^^^" L men. Ihumba.ils 
,hu!«nan ee a ,ep,eeen«,lv. picture u,d«.t.ng ''^ ■ '1^:1 aTrenS^eil f™m the diso. Thus, it is 
sre demonstrated frequentl,, these '° '=! 'f ^""i " ZZ^<y lor the menu thumbnails to be 

;s:re«r^;^trrmtr.prri^r^^^^^^^^^^^ 
r.sro:r:r;ar:eca:2theP,avustneed^^^^^^^^^ 

ma,K point pinure rather than a plctirre captured '^^ 'T^ ^ thumbnail, «hilst Fig.12 

100831 Fi9.1t Shows the 'f "^r;^" ''^„\™*f ^^^^^^ 

shows the relation between the mad< allixed to the Clip and „ „„, ^„es,eo to be 

the marK thumbnail is used in e.g a sub-menu -y^" 7= ."J^^^^^^ r.p«.ducing «.p.r.tus , 

rurpolno.r,tb,.e'r.cordi„g.^^^^ 

,0,34, 'Z'°°^^2<::'^^^^<^T^ " o rn^hulSa^d piur* ma«< thumbnails, the use, is no. 
fiSl^r^^-rrth^eiaticnbe^eenthamem^ 

rrt"hiTnrep"zrri=^s^=dr^^^^ 
re:rrx"2ra:r.~ 

bl^raL^r^adet^rerr-r^^^^^^^^ 

untt associated with lb. PTS, -•^^'^ f''l''''''^^''^^;'^,^l^tZtr^^ a data address In .he AV s.ream in 
lOOM] The EP.map is us^ ^'"^ S^g^^ .-^^p^,^,; t«^^^^^^^ EP-mapl used lor las, lon.ard playback or 

rirrrn\rr.ran"d:r™-c^^^^^^ 

stream cannot be analyzed, a TU.map is ^'"'^'f^^^Xtl^^^^^^ fi,e which stores the MPEG-2 trans- 

[0090] The STCInfo stores the discontinuous point information in the AV stream 

port stream. m Qxr thP same PTS values may appear in the AV stream 

'c£re¥:s dTmrindrir r t=\^^^^ — - 

Squence ln,o,m.«on is de«ned by ^TClnlo o. th. Clip 1^^^^^^^ ,^ ^ 

jsir^rurrar^r.^^^^^^^^^ 

cements ol an AV sBeam pnor o «5 ^'^■^"TT^:^^ audio componenB, such as HDTV «deo 

transmitting an audio or video ,„^„ screen ley illustrating to the ue«,he 

:;:eT^ trpSSt^r,:™:".""^"^ u scmg me s^te „ me AV decoder 

frsT"FTrS2:;,»e?*^"™rnrown.P,ogramln,o-ori.^^^^^ 
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2 transport stream. ««rtin<>nt tn thf* MPEG-2 transport stream and the AV stream. When 

and recorded on the disc. f„„„«,inn svstems for recording on the recording medium 1 00: 

It eai and re-multiplexed to a new-transport st^arn -";7;|;°J,*;;1\7,, and recorded on the disc, 

for standardizing the digital broadcast stream. In th « case «n EP-^|P ^^^^^^ confomiing to the ISDB 

r01031 For example, it is assumed that the mput stream .s an MPEG 2 tr^^P and the 

standard appellation of digrtal BS of Japan), f^^^^^^^^ 

SpeG AAC audio stream. The HDTV ^^^^^^J^^^^ and the transport stream both need to 

and the original AAC audio stream are re-mult.plexed to TS. The s>u 

conf omn to the ISDB f omnal. broadcast stream on the recording medium 1 0Ois to make transparent 

[OiMJ The dwaor, ^,>Kl the (te are I-"''"*" to^'**^^ airLloo. st™c.u,c on the disc. The di,«=tores 

format of the present embodiment. directories prescribed by the DVR application fomnat. 

[O^StI Below the "DATA" directory, there are stored allies and d^^^^^^^ J^^ ^^^^ ^ ^^^ual 

P1091 The-DVR- director, stores ,h..o _«,^ ^ . «o.a,r. Tlte 

he co..vreher.si.e Wormauoh ol ah W''?,''^" ,H, wormaBon pertloent to the rhehU thun«r,aite 

rrhe\r iiCtS:? 0^?,'^^^^^^ - . ^ to ..d .o -^.^^ . 

If there is no menu thumbnail, this file may not exist. thumbnail picture. Below the DVR directory. 

Ah -ooxx-rpls- me Mores th. lhlormat»h peron.nl to one nayus ,„ extender must he "rpls-. 

ls^»<»...pts-. Where •'^''^'Zl^^'^'^nTn ^ne^S^^^^ ^ ' WyV.vP'^" 

ro"«rr^.™-rTorsrer:rrr:r.ro.rd^X's.^2^^^^^^ 

information file corresponding to one AV st^e^mj'!'^^^^^ ^ 9 ^ extender must be "clpi". 

"zzzzzclpi". where -zzzzz" denotes five '"^"'^"^''^^^^'^i;^ file is an AV stream file handled by the DVR 
r01 141 The "M2TS" directory stores an AV stream file. The zzzzz.m^as 
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s,s«m This is a Clip AV file o, a Briage-Clip AV slrean. 111.. The lilename is -2Z«. mas", ««ere -«zzz- 

dvr" file. The "info.dvr" file is made up of three objects, that is DVRVoumei), i aoievji riayi. 

?01171 The syntax of info.dvr shown in Fig.15 isexplained. TheTableOfPlayLists Start address indic^^^^^^ 
addrlis of the TableOfPlayListsO in terms of the relative number of bytes from the leading byte of the .nfo.dvr" file. 

TrD'vS)^^^^^^^^^ contents of the volume (di^). R.1 6 ^^-^^ 

S the DVRVolume The syntax of the DVRVolumeQ, shown in Fig.16. is now explained. The version number ndicates 
fourcharcJfelrtters indicting the version numbers of the DVRVolume(). The vers.on.number is encoded to 0045 in 

I^TsoT L^enTh 'is denoted by 32-bit unsigned integers indicating the number of bytes from direct^ after the length 
field to the trailing end of DVRVolumeO. ...^^ - .^^ P,-„, p.avList or the Virtual PlayList reproduced last in 

JoiS Th"l ot'yte field of resume_PlayList_name indicates the filename of the Real PlayList or the Virtual PlayList 

^0130]" Fig.20 Shows the syntax of the TableOfPlayList(). whK:h is now -P'^'^^^^^^^^^ 
OfPlayListO indicates four character letters indicating the version numbers of the TableOfPlayLists. 
version.number must be encoded to -0045- ««;°'^^"^^„;r"^^^^^ TableOf PlayListQ from directly after 

rT^jpr^r™ — the 
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number of Ioods of the for-loop inclusive of the PlayListJile.name. This numerical figure must be equal to the number 
^fTlarLS^tlTeco^^^^^^^ Volume. The 1 0-byte numerical figure of the PlayListJile.name indicates the filename of 

rai32r^Ra%i shows another configuration ofthe syntax of the TabieOfPlayList(). The syntax shown in Fig.21 is com- 
Lrled of the svmrshown in Fig.20 in which is contained the UlApplnfoPlayList. By such structure mcludmg the 
uCpllJlayLCrt becLes possible to create a menu picture simply on reading out the TableOfPlayUsts. The 
fniinwina exDianation is premised on the use ofthe syntax shown in Fig.20. ^ ^ 

S ^he Sersi?iva^ in the info.dvr shown in Fig.15 is explained. The MakersPnvateData .s Provded to 
S thJmarer ofThe recording and/or reproducing apparatus 1 to insert private data of the maker ,n the MakersPr^ 
;r[^^i^)Tor spe^^^^^^ Of different companies. The private data of each maker has standard.z^ makerJD 

^nrtriPnt^ina the maker who has defined it. The MakersPrivateDataQ may contain one or more maker.lD. 
0 jrTa P eXakeT^^^^^ to insert private data, and the private data of a different maker is already contained 
le MaLrspSlDataO, the new private data is added to the MakersPrivateData() without erasing the pre-ex|st.ng 
o^Z^T^^^T^^. in the present embodiment, private data of plural makers can be contained ,n one MakersPn- 

SSrna 22 shows the syntax of the MakersPrivateData. The syntax of the MakersPrivateData shown in Fig.22 is 
Sed?heve^r^ 

of t^e ibleOfPlayListl The version_number must be encoded to "0045" in accordance wrth ISO 646 J-ength is a 
un^gnld 32 biVinLger indicating the number of bytes of the TableOfPlayList() from directly after the length field to the 

" S indicates the leading end address of the first mpd blockQ In ten.s of the 

^ . . nnmhrr of hutes from the leading byte ofthe MakersPrivateData(). The number_of_maker_entnes is the 16-bit 
Sdte's ntg r° ffTdf^^^^^^^^^ -tries of the maker private data Included in the ^f^l^^l^^^^^^^J";;;^ 

mutt not Le present two or more maker private data having the same makerJD values in the ^^«ke«P"7^«^^^^^^^^^ 
Sl371 ^he mpd blocks size is a 1 6-bit unsigned integer affording one mpd.block size in tem« of 1024 b^es ^a 
[0137J '"e mpo-o - indicates that the size of one mpd_block is 1024 bytes. The 

Tuler 7 r^pd' biocksTa"^^^^ affording the number of mpd_blocks contained in the MakersPri- 

^ateSi^?^^ ma^^^^ the 1 6-bit unsigned integer indicating the model number code of the DVR system which 
vateDataO^ me -- encoded to the maker.lD is specified by the licensor, 

fom? ma"^^^^^^ -^eger indicating the mode, number code of the DVR system 

[0138] The "^aker^°°J - , ^^^^^^ ^ the maker.model.code is set by the maker who has 

" LTeS^sl ofThe^^^^^ - a 1 6-bit unsigned integer indicating the number of 

IhTld blolk numblr a! S begrn! the'mak^r private data. The leading end of the maker private data must^e 
a,rgned wSL t ieX^^ of the mpd.b.ock. The start.mpd_b.ock_number corresponds to a vanable i in the for- 

K * The m^d length is a 32-bit unsigned integer indk^ating the size of the maker private data. The bjodcis 
an aria in whteh is'stofed maker private data. All of the mpd.blocks In the MakersPnvateDataQ must be of the same 

mi!im The real PlavList file and the Virtual PlayList file, in other words, xxxxx.rpis and yyyyy.vpis are explained^ 

?oT42r IhTMakeXviteDrta Start address indicates the leading address of the MakersPrivateDataQ. in terms 
StherelareZbero7b^esfrom 

loi'srThe padding word (padding word) is inserted in accordance with the syntax of the PlayList file, with N1 and 

ZVLl^^i^^^eSl^rnusXte referred by all PlayLists in the d^. Also, two or more Real PlayLists must not 

?o;tT teScTisTa™^^^^^ exist corresponding Real PlayL.ts. as 

SiowJ in rSa This rule is obsen/ed even after the editing operation has come to a close, as shown ,n Fig.24B. 
TK^rofnro all chds must be viewGCl by referencing one of Real PlayLists. . ^ . ^ 

raii^ Retr^J?trFS.2^^ the playback domain of the Virtual PlayList must be contained in the playback domain 
andTn the sSe-a^^^ playback dor^aiJ . There must not be present in the disc Bridge-Clip not referenced by any Virtual 
PlayList. 



25 



30 



35 



40 



45 



50 



55 

[0146] 



14 



EP 1 198 133 A1 



10 



15 



20 



25 



30 



35 



40 



45 



50 



55 



Uwa ns Ihe Playllsm list ana, « the CPl.type conla.~d .a P^^«0 Z^^^ZZr.. In tne PlayListO In the 
le Jn.nun,be, InOloete. lo- cherecter '"J ^^J^t uCnlt «.,TndS^^^^ total number o. 

(0,501 Th.Pl.yl;emJdcor,.JP=nd.n9» 

g;2;V''ruC!"oHe;tTL^=^ie.s,n,^^^^ 

values next following these valid ^►^^'^^^^^t"^.^^,"?^ date^^nd time on which the PlayList was recorded. This 

K ,i^^'^zr::r^-^'~^^^^^ ^ ^ ^ - ^ 

example. 2001/12/ 23:01 :02:03 is encoded to "Off °\122f0 0203 ^ ^.^^^^^ ^^^^^ 

^^^^^^^^ 

rrrere^;:hr.nrpzsrr„''s^^^ 

2001/05/07 is encoded to "0x20010507". „ tk^ ma tor of the DVR olaver (recording and/or repro- 

ducln9,pp.».ue "l'"^" *° "^^i^^ MieaUng the model numl»r ol the OVH 

rC^r Sa*rrSr^?e. .o tne ^..code . d«e^nad P, the 
maker «ho has received ttte license ol the DVFl lomal^ reproduced only »hen the user euccesstully 

S .rPirI^.^rS^irrr:^'- - m:; ^< ^ .he necess^ «, .P.«n, «,e 

1 .nte^ro,o..llag is set to V .he eontenU .1 ,h^ '„^::^r.^Zr;^<S'^'!. Z 

user proceeds to erase, edit or ovenvrrte the PlayList. PlayList, referencing the 

[01 591 The Real PlayList. in which the wnte j,rotect flag s set to 0. J-^V ^''^^J^^^f^^^^^^ ^ , „ the user is 
Clip o! the Real PlayList may exist, and the ^^^^^-P^^^TtIo^oIII ^pa^aruri sL^e^an alam, to the user as to 
desirous to erase the Real PlayList. the recordmg P SarPlavListTefore erasing the Real PlayList. 

the presence of the afo— 

SwIrrSoTed:^^^ 

[^erArchive is a two-t,it field indicating whether the P^y List .^^^ ^^eS^at^rhV;.:^^^^^^^^^^ 
Jield of ref_thumbnailjndex indicates jnfon^^^^^^^ :rmbna^;^^^^^^^ PlayList is added 

^^Z^-Z'^^:^::^^^ P-e . referenced using the value of 
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ativeofthePlayListisaddedinthePlayUst. RayltemO basically contains the following data: 

[01621 The Playltem is heremafter f J f '"^j^ 

Clip lnfonnationJile_name for spec.fy.ng the f ^"''^^^^^^^^^^ 3„d OUT-time in case the CPLtype def.ned .n 

current Playltem. oiowitomc these Plavltems are arrayed in a row, without temporal gap 

10,63, I. Pl.yl.ls. .s m.d. "■'J,""" " . OP -ST*^^^^^ ^"-"^ •«» Stc 
or werlap, or. iho global une «.s ol the Playua " ^1^ "yp .^^.^^^^ ssrtietme on me STC 
PlayLlsl does not have Ih. Brtd9«Sequec>ceO^ l^^nm. and ou^^^ P ^ 
Ln«n.ous d»naln as mat epecllled P, '"L^y^-^.^T d^lS WUlstO and. « the current Playltem has the 
[0164] B9.30 shows such a ease .n when the CPUype W J toes to me current Play- 
Bndgesetiuenceo. the rules as now .«pla.ned ^ ™ . LgeSequeocelnloO ol the current Play 
,,enCshown.slN_.™e1Jndlcatesthet™e..^^^^^^ 

PrTh-re^herrrt^^^^^^ 

r6ir tTcrty^^iTSyTr^™^^^^^ 

me Bme on ih. sarie Clio AV "^^^'T'^/'^fJo ^ „nMx of m. Playltem, shown in FigSZ, the new ot the 

'r7n,or,rrnai«:;«~^^ 
r6rouTrr.?sss,',r^^^^^ 

amers wim cpl.type defined In me condition between me previous Playltem aitd 

s:^u°p";i"srn;rrfgr?r3rr3»^^^^ 

S^rf , Bndgeseouencelnfo „ e«plalne<. w»h reference .0 ^ ™~rrB"^'::^^^^^^^^^ 'inlTs 

E^'c^=i^snarfo?tr..r^^^^^^^^^ 

specifying the corresponding Clip stream referenced by the previous Playltem. Next to 

^u^r^^^t^r-'.n^irrfhf sL^r^^^^^^ »■ - "'^ 

This address is tanned RSPN.enlerJO_cune.,t.Clip_ , Bddge^Cllp AV 

to,731 in Fig.37, f<sm-'^-'>^-'^'r"'ZZ^J^J^i^^^>'TJ<>'^^ IS defined in the CliplnfoO (FigXO). 

„ b-^rj^rorthtsrrme^^Y"^^^^^^^ 
hd'-d^iitinT/^^^^^^^^^^ — 

'Bridge Clip AV stream'. rnn is a relative address of a source packet on the Clip AV 

AV Stream file referenced by P'^''^""^ ^^""^^^^ Clio is the relative address of the source packet on the Clip AV 
r0176] The 32-bit field of RSPN_enter_to_curent_CI p .s the nelat^^^^^^ connected the last source packet of the 

" ;isE^trerLTe"S^^^^ 
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[0177] The SubPlayltem is explained with reference to Fig.39. The use of SubPlayltem() is permitted only If the 
CPUype of the PlayList() is the EP.map type. In the present embodinient, SubPlayltem is used only for audio post 
recording. The SubPlayltem() Includes the following data. First, it Includes Clip_lnformatlon_file_name for specifying 
the Clip referenced by the sub path in the PlayList. 

5 [0178] It also includes SubPath^lNJin^e and SubPath^OUTJime for specifying the sub path playback domain in 
the Clip. Additionally, it includes sync_PlayltemJd and start_PTS_of_ Play Item for specifying the time of starting the 
sub path reproduction on the main path time axis. The Clip AV stream, referenced by the sub path, must not contain 
STC discontinuous points (discontinuous points of the system time base). The clocks of audio samples of the Clip used 
in the sub path are locked to the clocks of the audio samples of the main path. 

10 [0179] Fig.40 shows the syntax of the SubPlayltem. Turning to the syntax of the SubPlayltem, shown in Fig.40, the 
field of the Clip_lnformation_file_name indicates the filename of the Clip Infomnation file and is used by a sub path In 
the PlayList. The Clip_stream_type defined in this Cliplnfo() must indicate the Clip AV stream. 
[0180] An 8-blt field of sync^PlayltemJd Indicates the sub path type. Here, only '0x00' Is set, as shown in Flg.41 , 
while other values are reserved for future use. 

15 [0181] The 8-bit field of sync_PlayltemJd indicates the Playltemjd of the Playltem containing the time of playback 
start of the sub path on the time axis of the main path. The value of Playltem_ld corresponding to the preset Playltem 
is defined In the PlayList() (Flg.25). 

[0182] A 32-bit field of sync_start_PTS_of_Playltem denotes the time of playback start of the sub path on the time 
axis of the main path, and denotes the upper 32 bits of the PTS (presentation time stamp) on the Playltem referenced 
20 by the sync_Playltem_id. The upper 32 bit field of the SubPath_IN_time stores the playback start time of the sub path . 
SubPath JN_tlme denotes upper 32 bits of the PTS of 33 bits corresponding to the first presentation unit in the sub path . 
[01 83] The upper 32 bit field of subPath_OUT_time stores the playback end time of the sub path . SubPath_OUT_tlme 
Indicates upper 32 bits of the value of the Presentatlon_end_TS calculated by the following equation: 

25 

Presentation_end_TS = PTS_OUT + AU_duration 

where PTS_out Is the PTS of the 33 bit length corresponding to the last presentation unit of the SubPath and 
AU_duration is the 90 kHz based display period of the last presentation unit of the SubPath. 

30 [0184] Next, PlayListMarkO in the syntax of xxxxx.rpis and yyyyy.vpis shown in Fig.23 is explained. The mark infor- 
mation pertinent to the PlayList is stored in this PlayListMark. Fig.42 shows the syntax of PlayListMark. Turning to the 
syntax of the PlayListMark shown in Flg.42, version_number is four character letters indicating the version number of 
this PlayListMarkO. The verslon^number must be encoded to "0045" In accordance with ISO 646. 
[0185] Length is an unsigned 32-bit integer indicating the number of bytes of PlayListMarkO from directly after the 

35 length field to the trailing end of the PlayListMarkO - The number_of_PlayListMarks is a 1 6-bit unsigned integer indicating 
the number of marks stored In the PlayListMark. The number_of_PlayListMarks may be zero. The mark_type is an 
8-bit field indicating the mark type and is encoded in the table shown in Fig.43. 

[01 86] A 32-bit filed of mark_tlme_stamp stores a time stamp indicating the point specified by the mark. The seman- 
tics of the mark_time_stamp differ with CPLtype defined in the PlayList(), as shown in Fig.44. The Playltemjd is an 
40 8-bit field specifying the Playltem where the mark is put. The values of Playltemjd corresponding to a preset Playltem 
Is defined In the PlayListO (see Flg.25). 

[0187] An 8-blt field of character_set shows the encoding method of character letters encoded In the mark_name 
field. The encoding method corresponds to values shown in Flg.19. The 8-blt field of namejength Indicates the byte 
length of the mark name shown in the mark_name field. The mark_name field denotes the mark name indicated in the 
45 mark_name field. The number of bytes corresponding to the number of namejengths from left of this field is the 
effective character letters and denotes the mark name. In the mark_name field, the value next following these effective 
character letters may be arbitrary. 

[0188] The field of the refjhumbnalljndex denotes the Infomnation of the thumbnail picture added to the mark. If 
the field of the refjhumbnalljndex is not OxFFFR a thumbnail picture is added to Its mark, with the thumbnail picture 
50 being stored in the mark.thmb file. This picture is referenced in the mark.thmb file, using the value of 
refjhumbnalljndex, as explained subsequently. If the refjhumbnalljndex field is OxFFFR It indicates that no thumb- 
nail picture is added to the mark. 

[0189] The Clip Information file Is now explained. The zzzzz.clpi (Clip Information file) is made up of six objects, as 
shown in Fig.45. These are CliplnfoO, STC_lnfoO: ProgramO. CPIO. ClipMarkO and Makers PrivateDataO- For the AV 
55 stream (Clip AV stream or Bridge-Clip AV stream) and the conresponding Clip Information file, the same string of nu- 
merals "zzzzz" is used. 

[0190] Turning to the syntax of zzzzz.clpi (Clip Infonmation file) shown in Fig.45 is explained. The 
Cliplnfo_Start_address indicates the leading end address of CliplnfoO with the relative number of bytes from the leading 
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end byte of the zzzzz.clpl file as a unit. The relative number of bytes is counted from zero. 

[0191] The STC_lnfo_Start_address indicates the leading end address of STC_lnfo with the relative number of bytes 
from the leading end byte of the zzzzz.clpi file as a unit. The Programlnfo_Start_address Indicates the leading end 
address of Progrannlnfo() with the relative number of bytes from the leading end byte of the zzzzz.clpi file as a unit. 
5 The relative number of bytes is counted from 0. The CPI_Start_address indicates the leading end address of CPI() 
with the relative number of bytes from the leading end byte of the zzzzz.clpi file as a unit. The relative number of bytes 
is counted from zero. 

[01 92] The ClipMark_Start_address indicates the leading end address of CllpMark() with the relative number of bytes 
from the leading end byte of the zzzzz.clpi file as a unit. The relative number of bytes Is counted from zero. 

10 The_MakersPrivateData Start_address indicates the leading end address of Makers PrivateData() with the relative 
number of bytes from the leading end byte of the zzzzz.clpi file as a unit. The relative number of bytes is counted from 
zero. The paddlng_word is Inserted In accordance with the syntax of the zzzzz.clpi file. N1 , N2, N3, N4 and N5 must 
be zero or optional positive integers. The respective padding words may also assume optional values. 
[0193] The Cliplnfo Is now explained. Flg.46 shows the syntax of Cliplnfo. Fig.46 shows the syntax of Cliplnfo. In 

15 the CllplnfoQ is stored the attribute information of corresponding AV stream files (Clip AV stream or Bridge-Clip AV 
stream file). 

[0194] Turning to the syntax of the Cliplnfo shown in ng,46, version^number is the four character letters Indicating 
the version number of this CllplnfoQ. The version_n umber must be encoded to "0045" in accordance with the ISO 646. 
Length is a 32-blt unsigned Integer Indicating the number of bytes of Cliplnfo() from directly at back of the length field 
20 to the trailing end of the Cliplnfo(). An 8-bit field of Clip_stream_type indicates the type of the AV stream corresponding 
to the Clip Information file, as shown in Fig.47. The stream types of the respective AV streams will be explained sub- 
sequently. 

[0195] The 32-bit field of offset_SPN gives an offset value of the source packet number of the first source packet 
number of the first source packet of the AV stream (Clip AV stream or the Bridge-Clip AV stream). When the AV stream 

25 file is first recorded on the disc, this offset_SPN must be zero. 

[0196] Referring to Fig.48. when the beginning portion of the AV stream file is erased by editing, offset_SPN may 
assume a value other than 0. In the present embodiment, the relative source packet number (relative address) refer- 
encing the offset_SPN is frequently described in. the fomn of RSPNxxx, where xxx is modified such that RSPN_xxx is 
RAPN_EP_start. The relative source packet number is sized with the source packet number as a unit and is counted 

30 from the first source packet number of the AV stream file with the value of the offset_SPN as the initial value. 

[01 97] The number of source packets from the first source packet of the AV stream file to the source packet referenced 
by the relative source packet number (SPN_xxx) is calculated by the following equation: 

^ SPN_xxx = RSPN_xxx - offset_SPN. 

Fig.48 shows an Instance in which offset_SPN is 4. 

[0198] TS_recording_rate is a 24-bit unsigned integer, which affords an Input/output bit rate required for the AV 
stream to the DVR drive (write unit 22) or from the DVR drive (readout unit 28). The record_time_and_date is a 66-bit 
40 field for storing the date and time of recording of the AV stream corresponding to the Clip and is an encoded represen- 
tation of year/month/day/hour/minute in 4-bit binary coded decimal (BCD) for 14 numerical figures. For example, 
2001/2/23:01 :02:03 is encoded to "0x20011223010203". 

[0199] The duration is a 24-bit field indicating the total playback time of the Clip by hour/minute/second based on 
arrival time clocks. This field is six numerical figures encoded in 4-bit binary coded decimal (BCD). For example, 01 : 
45 45:30 is encoded to "0x014530". 

[0200] A flag time_controlledJlag indicates the recording mode of an AV stream file. If this time_controlled_flag is 
1 , it indicates that the recording mode is such a mode in which the file size is proportionate to the time elapsed since 
recording, such that the condition shown by the following equation: 

50 

Ts_average_rate*192/188*(t - start_time)- a <= size_clip{t) 
<= TS_average_rate*192/188*(t - start_time) + a 

55 where TS_average_rate Is an average bit rate of the transport stream of the AV stream file expressed by bytes/second. 
[0201] In the above equation, t denotes the time in seconds, while start_time is the time point when the first source 
packet of the AV stream file was recorded. The size_clip(t) Is 10*192 bytes and a Is a constant dependent on 
TS_average_rate. 
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[0202] If time_controlled_flag is set to 0, it indicates that the recording mode is not controlling so that the time lapse 
of recording is proportionate to the file size of the AV stream. For example, the input transport stream is recorded in a 
transparent fashion. 

[0203] If time_controlled_f lag is set to 1 , the 24-bit field of TS_average_rate indicates the value of TS_average_rate 
5 used in the above equation. If time_controlled_flag is set to 0, this field has no meaning and must be set to 0. For 
example, the variable bit rate transport stream is encoded by the following sequence: First, the transport rate is set to 
the value of TS_recording_rate. The video stream is encoded with a variable bit rate. The transport packet is intermit- 
tently encoded by not employing null packets. 

[0204] The 32-bit field of RSPN_arrival_time_discontinuity is a relative address of a site where arrival timebase 
10 discontinuities are produced on the Bridge-Clip AV stream file. The RSPN_arrivaLtime_discontinuity is sized with the 
source packet number as a unit and is counted with the value of offset.SPN defined in the Cliptnfo() as from the first 
source packet of the Bridge-Clip AV stream file. An absolute address in the Bridge-Clip AV stream file is calculated 
based on the aforementioned equation: 

SPN.xxx = RSPN.xxx - offset^SPN. 

[0205] The 144-bit field of reserve r_for_system_use is reserved for a system. If is_formatJdentifier_valid flag is 1 , 
it indicates that the field of format_identifier is effective. If is_formatJdentifier_valid flag is 1 , it indicates that the 

20 formatjdentifier field is valid. If is_original_network_ID_valid flag is 1, it indicates that the field of 
is_transport_stream_ID-valid is valid. If the flag is_transport_stream_ID-valid is 1, it indicates that the 
transport_stream_ID field is valid. If ls_servece_ID_valid flag is 1 , it indicates that the servece_ID field is valid. 
[0206] If is_country code_valid flag is 1, it indicates that the field country_code is valid. The 32-bit field of 
formatjdentifier indicates the value of format_identifier owned by a registration descriptor (defined in ISO/IEC1 381 8-1 ) 

25 in the transport stream. The 16-bit field of original_networkJD indicates the value of the original_network_ID defined 
in the transport stream. 

[0207] The 16-bit field in servece_ID denotes the value of servece_ID defined in the transport stream. The 24-bit 
field of country_code shows a country code defined by IS031 66. Each character code is encoded by IS08859-1 . For 
example, Japan is represented as "J PN" and is encoded to "0x4A 0x50 0x4E". The stream_fon7iat_name is 1 5 character 
30 codes of ISO-646 showing the name of a fomiat organization affording stream definitions of transport streams. An 
invalid byte in this field has a value of 'OxFP. 

[0208] Formatjdentifier, originaLnetwork_ID, transport_stream_ID, servece_ID, country_code and 
stream Jormat_name indicate service providers of transport streams. This allows to recognize encoding limitations on 
audio or video streams and stream definitions of private data streams other than audio video streams or SI (service 

35 infomnation). These information can be used to check if the decoder is able to decode the stream. If such decoding is 
possible, the information may be used to initialize the decoder system before starting the decoding. 
[0209] STC_lnfo is now explained. The time domain in the MPEG-2 transport stream not containing STC discontin- 
uous points(discontinuous points of the system time base) is termed the STC_sequence. In the Clip, STC_sequence 
is specified by the value of STC_sequence_id. Figs.SOA and SOB illustrate a continuous STC domain. The same STC 

40 values never appear in the same STC_sequence, although the maximum tine length of Clip is limited, as explained 
subsequently. Therefore, the same PTS values also never appear in the same STC_sequence. If the AV stream contains 
N STC discontinuous points, where N > 0, the Clip system time base is split into (N+1) STC_sequences. 
[0210] STC_lnfo stores the address of the site where STC discontinuities (system timebase discontinuities) are pro- 
duced. As explained with reference to Fig.51 , the RSPN_STC_start indicates the address and begins at a time point 

45 of arrival of the source packet referenced by the (k+1 )st RSPN_STC_start and ends at a time point of arrival of the 
last source packet. 

[021 1] Fig.52 shows the syntax of the STC_lnfo. Turning to the syntax of STC_lnfo shown in Fig.52, version_number 
is four character letters indicating the version number of STC JnfoQ. The version_number must be encoded to "0045" 
in accordance with ISO 646. 

50 [0212] Length is a 32-bit unsigned integer indicating the number of bytes of STC_lnfo() from directly after this length 
field to the end of STCJnfo. If CPLtype of CP1() indicates TU_map type, 0 may be set in this length field. If CPLtype 
of CPIQ indicates EP_map type, the num_of_STC_sequence mut be of a value not less than 1 . 
[0213] An 8-bit unsigned integer of num_of_STC_sequence indicates the number of sequences in the Clip. This 
value indicates the number of the for-loops next following the field. The STC_sequence_id con-esponding to the preset 

55 STC_sequence is defined by the order in which appears the RSPN_STC_start corresponding to the STC_sequence 
in the for-loop containing the RSPN_STC_start. The STC_sequenceJd commences at 0. 

[0214] The 32-blt field of RSPN_STC_start indicates an address at which the STC_sequence commences on the 
AV stream file. RSPN_STC_start denotes an address where system time base discontinuities are produced in the AV 
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stream file The RSPN STC start may also be a relative address of the source packet having the first PCR of the new 
Ivstem time base in the AV stream. The RSPN_STC_start is of a size based on the source packet number and .s 
counted from the first source packet of the AV stream file with the offset.SPN value defined m Cl.plnfo() as an inrt.al 
value. In this AV stream file, the absolute address is calculated by the above-mentioned equation, that is 



SPN_xxx = RSPN_xxx - offset_SPN. 



10 
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r02151 Programlnfo in the syntax of zzzz.clip shown in Fig.45 Is now explained with reference to Fig 53. The time 
doma n haling the following features in the Clip is temied program_sequence. These feature are that the value of 
Pirns not changed, the number of audio elementary streams is also not changed, the PID values in the respective 
video streams are not changed, the encoding information whtoh is defined by VideoCodlnglnfo thereof is not changed 
*e nur^ber o' audio elementary streams is also not changed, the PID values of the respective audio streams are not 
chanaed and that the encoding information, which is defined by AudioCodinglnfo thereof, is not changed. 
ra216l Program sequence has only one system time base at the same time point. Program_sequence has a sole 
PMT at the samelfme point. ProgramlnfoQ stores the address of the site where the program.sequence commences. 
Rcipw nroaram sequence-start indicates the address. 

roll 71 Fig 54 iilustrates the syntax of Programlnfo. Turning to the Programlnfo shown in Fig.54. version nurnber.s_ 
four character letters indicating the version number of ProgramlnfoQ. The version_number must be encoded to 0045 

" I'^^'^LengtrL'f^^^ integer indicating the number of bytes of ProgramlnfoQ from directly at back of 

S lenqth field to the end of program(infoQ. If CPl.type of CPIQ indicates the TU.map type, this length field may be 
set to 0 f t^e CPl type of CPIQ rndicates EP_map type, the number_of_programs must be of a value not less than 1 . 
[o1«r An 8-bit uSned integer of number_of_program_sequences denotes the number of program sequences .n 

23 Se C p tL value indteates the number of for-loops next following this field. If program_sequence in the Clip >s not 
Changed 1 must be set in the number of program.sequences. A 32-bit field of RSPN_program_sequence_start is a 
relative address where the program sequence commences on the AV stream. . ^ . . ^ .„i,h ,h„ 

02201 RSPNorogram sequence.start is sized with the source packet number as a unit and .s «^ur,ted with the 
Eof offset_fpN defined in the CliplnfoQ as from the first sou-^e packet of the AV stream file. An absolute address 

30 in the AV stream file is calculated by: 



55 



SPN_xxx = RSPN_xxx - offset_SPN. 



35 The values of RSPN_program_sequence_start in the for-loop syntax must appear in the rising order^ 

ra22^1 A 1 6-biTfield of PCR PID denotes the PID of the transport packet containing an effective PCR field effective 
for the program sequence. An 8-bit field of number_of_audios indicates the number of for-loops containing 
audio stream pfD and AudioCodinglnfoQ . A 1 6-bit field of video_stream_PID indicates the PID of the transport packet 
comai a vrdeo stream effective for rts program.sequence. VideoCodinglnfoQ. next following this field, must explain 

40 the contents Of the Video stream referenced by Its video_stream_PID. ^ ^. , « 

2^21 r6bitfieldofaudio_stream 

forits program sequence. The AudioCodinglnfoQ. next followingthis field, must explainthe contents of the vide^ 
r^»f*»rf> need bv its audio stream_PlD. 

Si The'order in which the values of video_stream_PlD in the f or-loop of the syntax must be equal to the sequence 
« S?ID encoding of the video stream in the PMT effective for the program.sequence. Additionally, the order mwh ch 
L values of audio stream.PlD appears in the for-loop of the syntax must be equal to the sequence of PID encoding 
of the audio stream in the PMT effective for the program.sequence. . -/i -r..r„i„« t« tho 

r02241 Fio 55 shows the syntax of VideoCodlnglnfo in the syntax of the Programlnfo shown in Fig.54. Tuming to the 
symS of t^e^deToding Info shown in Fig.55. an 8-bit field of videojom^at indicates the video fomnat corresponding 
50 to video stream PID in ProgramlnfoQ. as shown in Fig.56. 

I02S1 Referring to Fig.57. an 8-bit field of frame.rate indicates the video frame rate corresponding to the 
!Jdeo_stream_PID in ProgramlnfoQ. An 8-bit field of display.aspect.ratio indicates a video display aspect ratio corre- 
sponding to video_stream_PlD in ProgramlnfoQ. . ci- -r..r«io« to the 
r02261 Fio 59 shows the syntax of AudioCodinglnfo in the syntax of Programlnfo shown in Fig.54. Turning to the 
[OZ2bj rig.ow fi>Muw« / ^ ^ ^ ^.^ 4 s«r«/*ot«e tHo 9iiHin pncodina method 



S JS:i:^Z^Z:^^^^^ audiojor^at indicates the audio encoding method 

?0^?rA:-rS"^^^^^^^^^ component type corresponding to 

audio_straam_PID in ProgramlnfoQ as shown in Fig.61 . whilst an 8-bit field of sampling_frequency indicates an audio 
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s».p,ing fr«,.»nc corresponding to i" ^'^"^'^^^^^^^^ expteln^l, Tho OP, 

an SESF .rinsport «r.an>. m» corresponding Clip mus, own .n EP-^*^ ,„ pig SS. Ih. version.number Is lour 

EP_m.p lor . .Id«> suesm and .n EP.msp for '"'^J^^^'Z'T^'t, .he'video slrean, must 

rr;rc^;-ssrn\'^'5r= 

da.a s.ream_PID, PTS-EP sM and «f ™-^^-^';,;"p^'2 an'aocose unl, beginning from .he soguonce noader 

sr™iThepsPN!sp sSr„«^^^ 

unit roler.i«ed by the PTS.EP.Start In the AV strean^ transmitted by the 

SUal-r In'jrs^^o^iri^^^^^^ - ^ - Ollp, the EP.map ntay contain 

fSrrt;!:^^ «f =-.--as data stre^ P^^^^^^^^^ 

access unit referenced by PTS_EP_start of the AV stream. transmitted by the 

Kort;!:.^^^^^^^^^^ 

one table irrespective o,d.scon jnuouspom^^^ ^-.^^^.^g 

of RSPN_STC_start defined in STC_lnfo() reveals Doun y continuous stream 

STC.sequences (see Fig.68). The EP.map must have ^"^//-^^P-^^^^^^^^^ have the same video RID. 

range transmitted by the same PID In the case shown m Rg^69. P-g^^/J ^"^^ ^-^^ each program, 

however, the data range is not continuous, so that shown in Fig.70. the EP_type 
[0236] Fig.70showstheEP_mapsyntax.Bywayofexp^an^^oftheEP^^^^^^ 

\s a 4-btt field and shows the EP.map entry point type, f stram the E^^^ must be set to 0 (Video'). 

rr:r.y.^r?;^^^^^^^^^^^ 

Sir^^ie .a-bit field of number_of.stream_P.Dsin^^^^^^^^ 

number.of_stream.PIDs in the EP_map() as a va"aWe. ;«^;^/^^^';^;^",7^^^^^^^ referenced by 

st^f^^EP^pe- is e.ua1 to 1 Vaudio-). .s f '--^IV ^^^^^^^^^ EP map_entries(K)). 

[0238, The 16-bit field Of r^m^^^^^^^^^^^^ 

ie^l^'^^ne^^^^^ 

pJdSiJg rnJmuiTe inserted in accordance with the EP_map() syntax. X and Y must be optional positive 
integeiB. The respective padding words may assume °P^'°"f '^Jl^^i, explanation of the syntax of the 

[0240] Fig.72 shows the syntax of EP-map_for_one_stream PliD^ By ^^f «eYd o^ PTS EP start differs with the 
U.map.for.one stream PID 

^thfa^^et fni L'St^^^^^^^^ ^^'^ — ^ f '"'^'^^ ^ " ' 

field h^^Pper Sa bits of PTS of 33 bit precision of the access unit of the audio stream. 
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rn^dil The semantics of the 32-bit field of RSPN_EP_start differs with the EP.type defined in EP_map(). If EP.type 

hrder Ifihe acc^^^^^ referenced by the PTS_EP_start in the AV stream. Alternatively, if EP.type .s equal to 1 
SJo-) trfie^tndica^^^^^^^^ of the source packet containing the first byte in the aud.o stream of 

thP access unit referenced by the PTS_EP_start in the AV stream. 

5242? RSPN EP start is of a size which is based on the source packet number as a unit, and .s counted rom the 
Ku^p^ket o7 the AV stream file, with the value of the offset_SPN. defined in CliplnfoQ. as an ,nrt,al value, "me 
absolute address in the AV stream file is calculated by 



SPN_xxx = RSPN_xxx - offset_SPN. 

It is noted that the value of th« 

[0244] 



rn94^i It Is noted that the value of the RSPN_EP_start in the syntax must appear in the rising order 
SzS Tl^^ map is now explained wfth reference to Fig.73. TU.map fom,s a time «-'=^.''«^^^°"^^!^^2?f 
nit;! arrival tim^ clock (timepiece of the arrive time base). This time axis is temied TU_map_t.me_^.s. The po nt o 
^9^0?^^; rp tte^is is'indicated by offset_time in the TU.mapQ. TU_map_time_axis is divided ,n a preset unit 

\Trn. L Lred in Tu'map These addresses are termed RSPN_time_unit_start. The time at which begins he k(k > 
O^tfrlTeinT o:the f U^^^^^ is termed TU_start_time(k). This value is calculated based on the follow.ng 

equation: 



TU_start_time(k) = offset_time + k*time_unit_si2e. 



ro2461 It is noted that TU start_time(k) has a precision of 45 kHz. . c- -7/1 tKo'^^wt 

Vc^^ 74 shows the syntax of TU map. By way of explanation of the TU_map syntax shown m Fig.74, the 32-b.t 
0247] r'^;^^ an^off^^^^^ TU map time axis. This value indicates the offset time relative to 

hTfiStre- nTin'th^^^ ZeZ^el of a ^ize^lsedon 45 kHz clock derived from the 27 MHz precision 

S Thf32 biS^^^^^^^^ affords the size of the time_unit. and is based on 45 kHz ck>cks denved 

?omL 27 MHz precision arrival time clocks, as unit. Preferably. time_unit_size ,s not longer than one second 
(Ze unit^Le ^ ^0^^^^^^^^ 32 brt field of number_of_time_untt_entries indicates the number of entries stored in 

, JJilTThe 32-bit field of RSN_tlme_unit_start indicates the relative address of a site in the AV f ^^J^^'^J 
L JJ^it^rirMt RSN time unit start is of a size based on the source packet number as unrt and is counted 

The absolute address in the AV stream file is calculated by 

° SPN_xxx = RSPN_xxx - offset_SPN. 

r02501 It is noted that the value of RSN_time_unit_start in the for-loop of the syntax must appear in the rising order 
If fherl iJ no sourcrplcket in the number (k.1) time_unit. the number (k.1) RSN.time.unit.start must be equal to 

" roasTSZ^ofUTa^^^^^^^ ClipMark in the syntax of zzzzz.c.ip shown in Fig.45. t^e C.ipMartc is the ma* 
Sation pertinent to clip and is stored in the ClipMark. This mark Is not set by a user, but is set by a recorder 
(r^rding an^orr^^^^^ By way of explanation of the ClipMark syntax shown in Fig.75. the 

lersfon number Jour character letters'lndicating the version number of this ClipMark. The version.number must be 

Sr te^'^T^STul^n^m^^^^^n^ the number of bytes of the ClipMark() as from directly after the 
Sfie^ ^o thL t'alfnt end of ClipMaScQ. The number_of_Clip_marks is a 16-bit unsigned integer '"d^^ng the 
nuir o^marst^^^^^^ ClipMark and may be equal to 0. Mark_type is an 8-blt field indicating the mark type and .s 
encoded in accordance with the table shown in Fig.76. 

ra2541 MaTtime stamp is a 32-bit field and stores the time stamp indicating a pointer having a specrfied mark. The 
semantics of mark time stamp differs with CPl.type in the PlayListQ. as shown in F.gT7. 

[oTsin CPLty^'e in CPI() indicates the EP.map type, this 8-bit field indicates the STC.sequence.id of the cont.n- 
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uous STC domain where there is placed mark_time_stamp. If CPLtype in CPI() indicates TU_map type, this 8-bit field 
has no meaning but is set to 0. The 8-bit field of Character_set indicates the Indicating method of character letters 
encoded In the mark_name field. The encoding method con-esponds to the value shown In Flg,1 9. 
[0256] The 8-blt field of name_length indicates the byte length of the mark name shown in the mark_name field. This 
5 mark_name field indicates the mark name. The byte number corresponding to the number of the name_length from 
left of this field is the effective character number and denotes the mark name. In the mark^name field, the values next 
following these effective character letters may be arbitrary. 

[0257] The field of ref_thumbnailjndex indicates the information of the thumbnail picture appended to the mark. If 
the ref_thumbnaiLindex field is of a value different from OxFFFF, a thumbnail picture is added to its mark, with the 
10 thumbnail picture being stored in the mark.thumb file. This picture is referenced using the value of ref_thumbnailjndex 
in the mark.thumb file. If the ref_thumbnailjndex field is of a value equal to OxFFFF, a thumbnail picture is not appended 
to its mark. 

[0258] MakerPrivateData has already been explained with reference to Fig.22 and hence is not explained here spe- 
cifically. 

15 [0259] Next, thumbnalljnfonnation is explained. A thumbnail picture is stored in a menu.thmb file or in a nriark.thmb 
file. These files are of the same syntax structure and own a sole ThumbnailQ. The menu.thmb file stores a picture 
representing respective PlatyLists, The totality of menu thumbnails are stored in the sole menu.thmb file. 
[0260] The mark.thmb file stores a mark thumbnail picture, that is a picture representing a mark point. The totality 
of mark thumbnails corresponding to the totality of PlayLists and Clips are stored in the sole mark.thmb file. Since the 

20 thumbnails are frequently added or deleted, the operation of addition and partial deletion must be executable readily 
and speedily. For this reason, Thmbnail() has a block structure. Picture data is divided into plural portions each of which 
is stored in one tn_block. One picture data is stored in consecutive tn_blocks. In the string of tn_blocks, there may 
exist a tn_block not in use. The byte length of a sole thumbnail picture is variable. 

[0261] Fig.78 shows the syntax of menu.thmb and mari<.thmb and Fig.79 the syntax of Thumbnail in the syntax of 
25 menu.thmb and mark.thmb shown in Fig.78. By way of explanation of the syntax of Thumbnail, shown in Fig.79, 
version_number Is four character letters denoting the version number of this Thumbnall(). Version_n umber must be 
encoded to "0045" in accordance with ISO 646. 

[0262] Length is a 32-bit unsigned integer Indicating the number of bytes of MakerPrivateDataQ as from directly at 
back of the length field up to the trailing end of Thumbnail(). Tu_block_start_address is a 32-bit unsigned integer 

30 indicating the leading end byte address of the first tn_block, in tenns of the relative number of bytes as from the leading 
end byte of Thumbnail() as a unit. The number of relative bytes is counted from 0. Number_of_thumbnails is a 16-bit 
unsigned integer which gives the number of entries of a thumbnail picture contained in ThumbnailQ. 
[0263] Tu_block_size is a 1 6-bit unsigned Integer which gives the size of one tn_block, in terms of 1024 bytes as a 
unit. If, for example, tn_block_size = 1 , it indicates that the size of one tn_block is 1024 bytes. Number_of_tn_blocks 

35 is a 1 1 6-bit unsigned integer indicating the number of entries of tn_block in this Thumbnail. Thumbnailjndex is a 1 6-bit 
unsigned integer indicating the index number of the thumbnail picture represented by the thumbnail information for 
one for-loop beginning from the thumbnail_index field. The value OxFFFF must not be used as ThumbnaiLindex. This 
Thumbnailjndex is referenced by refjhumbnailjndex in UlApplnfoVolumeQ, UlApplnfoPlayListQ, PlayListMart<() and 
ClipMarkO. 

40 [0264] Thumbnail_picture_fonnat is an 8-blt unsigned integer representing the picture fomnat of a thumbnail picture 
and assumes a value shown in Fig.80. In the table, DCF and PNG are allowed only in menu.thumb. The mark thumbnail 
must assume the value of "0x00" (MPEG-2 Video 1 -picture). 

[0265] Picture_data_size is a 32-bit unsigned integer indicating the byte length of a thumbnail picture in terms of 
bytes as a unit. Start_tn_block_number is a 16-bit unsigned integer indicating the tn_block number of the tn_block 
45 where data of the thumbnail picture begins. The leading end of the thumbnail picture data must coincide with the leading 
end of the tn_block. The tn_block number begins from 0 and is relevant to the value of a variable k in the for-loop of 
tn_block. 

[0266] X_plcturejength is a 16-bit unsigned integer indicating the number of pixels in the horizontal direction of a 
frame of a thumbnail picture. Y_picture_length is a 1 6-bit unsigned integer indicating the number of pixels in the vertical 

50 direction of a frame of a thumbnail picture. Tn_block is an area in which to store a thumbnail picture. All tn_block in 
the ThumbnailO are of the same size (fixed length) and are of a size defined by tn_block_sixe. 
[0267] Figs. 81 A and 81 B schematically show how thumbnail picture data are stored in tn^block. If. as shown in Figs. 
81 A and 81 B, the thumbnail picture begins at the leading end of tn_block, and is of a size exceeding 1 tn_block, it is 
stored using the next following tn_block. By so doing, data with a variable length can be managed as fixed length data. 

55 so that the editing of deletion can be coped with by simpler processing. 

[0268] An AV stream file is now explained. The AV stream file is stored in the ■'M2TS" directoiy (Fig.14). There are 
two types of the AV stream file, namely a Clip A stream file and a Bridge-Clip AV stream file. Both AV streams must 
be of the structure of DVR MPEG-2 transport stream file as hereinafter defined. 
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[0269] First, the DVR MPEG2 transport stream is explained. The structure of the DVR MPEG-2 transport stream is 
shown in Fig.82. The AV stream file has the structure of a DVR MPEG 2 transport stream. The DVR MPEG 2 transport 
stream is made up of an Integer number of Aligned units. The size of the aligned unit is 6144 bytes (2048*3 bytes). 
The Aligned unit begins from the first byte of the source packet. The source packet is 192 bytes long. One source 
5 packet is comprised of TP_extra_header and a transport packet. TP_extra_header is 4 bytes long, with the transport 
packet being 1 88 bytes long. 

[0270] One Aligned unit Is made up of 32 source packets. The last Aligned unit in the DVR MPEG 2 transport stream 
Is also made up of 32 source packets. Therefore, the DVR MPEG 2 transport stream ends at a boundary of the Aligned 
unit. If the number of the transport packets of the Input transport stream recorded on a disc is not a multiple of 32, a 
10 source packet having a null packet (transport packet of PID = 0x1 FFFF) must be used as the last Aligned unit. The file 
system must not use excess infonnation in the DVR MPEG 2 transport stream. 

[0271] Fig.83 shows a recorder model of the DVR MPEG 2 transport stream. The recorder shown In Fig.83 is a 
conceptual model for prescribing the recording process. The DVR MPEG 2 transport stream obeys this model. 
[0272] The input timing of the MPEG 2 transport stream is now explained. The input MPEG 2 transport stream is a 
15 full transport stream or a partial transport stream. The input MPEG 2 transport stream must obey the ISO/IEC1381 8-1 
or ISO/IEC 13818-9. The number i byte of the MPEG 2 transport stream is input simultaneously at time t(i) to T-STD 
(transport stream system target decoder provided for in SO/tEC13818-1) and to the source packetizer. Rpk is an in- 
stantaneous maximum value of the input rate of the transport packet. 

[0273] A 27 MHz PLL 52 generates a frequency of 27 MHz clock. The 27 MHz clock frequency is locked at a value 
20 of the program clock reference (PGR) of the MPEG 2 transport stream. An arrival time clock counter 53 counts the 
pulses of the 27 MHz frequency, ArrivaLtime_clock(i) is a count value of the arrival time clock counter at time t(i). 
[0274] A source packetizer 54 appends TP_extra_header to the totality of the transport packets to create a source 
packet. ArrivaLtime_stamp indicates the time when the first byte of the transport packet reaches both the T-STD and 
the source packetizer. ArrivaLtime_stamp(k) is a sampled value of the ArrivaLti.me_clock(k) as represented by the 
25 following equation: 

arrivaLtime_stamp(k) = an'ivaLtlme_clock{k)% 230 

30 where k denotes the first byte of the transport packet. 

[0275] If the time separation between two neighboring transport packets is 230/2 7000000 sec (about 40 sec) or 
longer, the difference of the arrivaLtime_stamp of the two transport packets should be set to 230/2 7000000 sec. The 
recorder is provided for such case. 

[0276] A smoothing buffer 55 smoothes the bitrate of the input transport stream. The smoothing buffer must not 
35 overflow. Rmax is the output bitrate of the source packet from the smoothing buffer when the smoothing buffer is not 
null. If the smoothing buffer is null, the output bitrate of the smoothing buffer is 0. 

[0277] Next, the parameters of the recorder model of the DVR MPEG 2 transport stream are explained. The value 
of Rmax is given by TS_recording_rate as defined in Cllplnfo() associated with the AV stream file. This value may be 
calculated from the following equation: 

40 

Rmax = TS_recording_rate*1 92/1 88 

where the value of TS_recording_rate is of a size in bytes/second. 
45 [0278] If the input transport stream is an SESF transport stream, Rpk must be equal to TS_recording_rate as defined 
in ClipinfoO associated with the AV stream file. If the input transport stream is not an SESF transport stream, reference 
may be made to values defined e.g., in a descriptor of the MPEG 2 transport stream, such as 
maxim um_bitrate_descriptor or partial_stream_descriptor for this value. 

[0279] If the input transport stream is an SESF transport stream, the smoothing buffer size is 0. If the input transport 
so stream is not an SESF transport stream, reference may be made to values defined in the descriptor of the MPEG 2 
transport stream, such as, for example, the values defined in the smoothing_buffer_descriptor, short_smoothing 
_buffer_descriptor or in the partlaLtransport_stream„descriptor. 

[0280] For the recorder and the player (reproducing apparatus), a sufficient size buffer needs to be provided. The 
default buffer size is 1536 bytes. 
55 [0281] Next, a player model of the DVR MPEG 2 transport stream is explained. Fig. 84 shows a player model of the 
DVR MPEG 2 transport stream. This is a conceptual model for prescribing the reproduction process. The DVR MPEG 
2 transport stream obeys this model. 

[0282] A 27 MHz X-tat 61 generates the frequency of 27 MHz. An error range of the 27MHx frequency must be ±30 
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ppm (2 7000000. 810 Hz).The arrival time clock counter62 isabinarycounterforc^^^^^^ 

^r^T MH7 Arrival time clock(i) is a count value of the arrival time clock counter at time t(i). . ^ ^ ^ 
ol^r n rslXn buffer 64, Rmax is the input t,itrate o, the sou«:e packet tojhe -o°t .n^^^^ when the 

smoothing buffer is not full. If the smoothing buffer is full, the input bitrate to the smoothing ^""^'^ 'J . 

rSSl Bv wav of explaining the output timing of the MPEG 2 transport stream, if the amvaLtime_stamp of the current 
ou^i pai^s equaC3o'bns on the LSB side of arrival_time_cloclc(i). the transport packet of tlie s-rce p^^^^^^^^ 

removed fSm the smoothing buffer Rpk is an instantaneous maximum value of the transport packet rate. The overflow 

t^rTT,!^^:: mode, Of the DVR MPEG 2 transport stream are the same as those of the 

-£rZ~^"s^^^^^^^ - ' transport stream provided 

i::^::^^e . transport packets. If the input transpo-.am . 

^o2ed uslihe^EEE1394 digital interface, the value of copy_pemiissionJndicator may assoc ated wrth the 
IS^S EM (enc^ption mode indicator). If the input transport stream is recorded without employing the 'EEE1394 
Sal inte^ace ^e value of copy_pem,issionjndicator may be associated wtth the value of the CCl embedded m the 
SoCc 'e^^^^^^^ -S-! input is self-encoded, the value of copy_pem,ission_indicator may be associated 

an-ivaLtime_stamp(k) = arrivaLtime_clock(k)%230. 

r02891 Bv way of defining the ClipAV stream, the ClipAV stream must have a structure of the DVR MPEG 2transport 
, Hr«n»ri a? described above Arrival time clock(i) must increase continuously in the Clip AV stream. If there 
rsrar:ntiruot'poS,fof'^^^^^^^^ ba-se (ST^ base) in the Clip AV stream. arrival_time_c.ock(i) in the C.p 

r^29TTh7r^y:im"m^^^^^^^^^ 

Av !?Lm r^uTt br26 hours This limitation guarantees that, if there is no discontinuous point in the system time base 
^Tc'a'ern^^^^^^^^^^ (presentation time stamp) of the sarne value neverappears m 

ih Jcifp AV s^am The MPEG 2 system standard provides that the PTS has a wraparound penod of 233/90000 sec 

SSli ^^^v waTcJf defining the Bridge-Clip AV stream, the Bridge-Clip AV stream must have a structure of the DVR 
MPEG 2 tr^nZrt stream defined as described above. The Bridge-Clip AV stream must include a discontinuous point 
Of one arJrSme bSe The transport stream ahead and at back of the discontinuous point of the arnva. time base 

mlsJ^onnStioi bSSeen Playltems guarantees "continuous data supply" to the player/decoder and "seamless 
S^o^ino or^eSST^ Th^continuous daL supply" is the capability of guaranteeing data supp^f to the decoder at a 
Se nl^Sr, toVlven^^^^^ underflow. In olrder to enable data to be read out from the disc as data real-t.me 
o oTertteT^S alured data is to be stored in temis of a continuous block of a sufficient^ large size as a unit. 
f^sSl Th?4aT^^^^^^ processing" means the capability of a player in displaying audio video data recorded 

dS o7a obvious Piayltem and the current Playltem is guaranteed may be verified from the "ff '°" 

SS SLd'irf re current Playltem. There are two methods for seamless connection of Playltems. that is a method 

ToTsr -^^^^^^^^^^^ and the current Playltem in case of emptying 

BSai-Cto in pfg 88 the stream data, read out by the player, is shown shaded. In Fig.88 TS1 is made up of shaded 
st^famlma ^f Se Clipl (Clip AV stream) and shaded stream data previous to RSPN_amvaLtime_discontmui^ 
STiT The shaded stream data of Clipl of TS1 is stream data from an address of a stream required for decoding 
trplelSifn^c^^^ 

naokPt referenced by RSPN exit from_previous_Clip. The shaded stream data pnor lo 
^N.arrilarS^ntinufty of Bridgelciip contained in TS1 stream data as from the first source packet of 
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Bridge-Cip up to the sou.e pacKet directly previous to the source packet referenced by 

RSPN_arrivaLtime_discontinuity. ^..^ „f ri.n friio AV stream) and shaded stream data subse- 

[0297] in Fig.88.TS2 is made up of shaded stream data of Clip 2 (Clip AV str^^^^ 

quent to RSPN_arrival_time_discontir,uity ^^^f "^AP, Ji^ ^^^.^^^^^ 

RSPN_arrivaLtime_discontinuity of Bridge-Chp '"J_^f.^^^^^^^ yt shaded stream data of Cllp2 of TS2 is 

RSPN_arrival_time_discontinuity to the last P^'^f * °' ^"f ^^^^^^^^ address of the stream required 

stream data from the source packet -^--^-^^^V "^^^^^^^^^ by OUT_time2 in Fig.88). 

for decoding the presentation unrt corresponding to O^^-^^J. °* Vlayltem in case of not employing 

fs^T«r.sr scrp^nrrror^otr" ^^^^^^^^ « 

IN time1 in Fig.89 as far as the last source packet of Clip1 • 

(shown at OUT„time2 in Fig.89). ^ tK« eo.imo nacket Next the streann provisions of 

grams contained in TS1 and TS2 "^"^i oe v i ne numbers of the audio streanr« contained in 

;ra™ure~ err"; 7lZo^L°\^.n..^ streams or pr.ate streams other than 

cated by a picture display sequence. In o^^^-J^^^^'^.^^ ^;;!^"^.S'ut ^^^^^^^ 
junction point, unneeded pictures displayed at back Of OU^^^^^^^^ 

n^^xrorti^r^^^^^^ 

rndXencoded to fo-m, an elemental stream -"^^^^^^N a^^a^t^e^^^^^^ is made up of an encoded 

t0304] The Video stream of Bridge-Cl.p ^"b^^^"^"' ^° "^^^"^^^^^^ decoding of this video stream 

lideo stream subsequent to a picture corresponding to 'N-*''"^^ of C Iip2 of Fig^^^^^ Re-oncoding is made 

canbestartedcorrectlyforconnectingthevdeostj^amtothe^ 

must commence at a closed GOP. z,,^^^ fiolH^ must be continuous with a junction point 

may made to prevent field gaps Irom bemg produced^ M,.„^ me audio sampling frequency ol TS1 and 

ST£m""r;':,t:rrsrrr::^^^^^^^^^^^ 

layer 2, AM, SESF LPCM and AAC) must J^"'"'' '"??/,'''L^„„ ^ream the last audio Irame of the audio 
[03091 By way of .xpfainlng "»««^ TZm^-mS^ fo the ilspla, end Uo* ol the last display 

=:;T7,\r,rSo~traurorarrs2™'.4^^^ 

equal to the display start timing of the first display picture of TS2. 
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r0310l At a junction point, no gap may be allowed to exist in a sequence of the audio presentation units. As shown 
n Fiq 93 he e may be an overiap defined by the length of the audio presentation unit less than two aud.o f ran.e 
doS:The firrpacket transmit^ng an elementary stream of TS2 must be a video packet. The transport stream at 
the iunction point must obey the DVR-STD which will be explained subsequently. 

[031irBy way o, explaining limitations on the Clip and Bridge-Clip, no discontinuities in the amval t.me base are 

maiT The follTng ZZ^ are applied only to the case of employing the Bridge-Clip. The Br*dge-Cllp AV ^rea^^ 
has a sole discontinuous point in the arrival time base only at a junction point of the last source packet of TS 1 and the 
fiit source packet of TS2 The SPN_arrivaLtime_discontinuity defined in Cliplnfo() represents an address of the dis- 
continuous point which must represent the address referencing the first source packet of TS2. 
m3 31 The source packet referenced by RSPN_exit_fromj,revious.Clip defined in BridgeSequencelnfoQ may be 
anv sLri pikeTin Clip1 . It is unnecessary for this source packet to be a boundary of the Al.gned unrt. The source 
packet referenced by RSPN_enter_to_current_Clip defined in BridgeSequencelnfoQ may be any source packet rn 
r-iir^o It telinnecessarv for this source packet to be a boundary of the Aligned unit. 

SSl srway of ex^a^ing limitations on Playltem. the OUT.time of the previous Play Item (OUT_time 1 shown rn 
Rg 89) must represent the display end time of the last video presentation unit of TS1 The IN.time of the current 
Plav^mToN Ze2 shown in Fig.88 and 89) must represent the display start time of the first presentatoon unit of TS2 . 
Ss^^X^rof explaining the limitations on the data allocation in case of employing Bridge-Clip by refernng to Fig. 
Sf t?e sSr^less connection must be made to guarantee continuous data supply by the file system Jh is must be 
reaSo6tyT^n^°gX^B Bridge-Clip AV stream, connecting to Clip1 (Clip AV stream file) and Clip2 (Clip AV stream 
fiip^ such as to satisfy data allocation prescriptions. 

Mlil RSPN exit from_previous Clip must be selected so that the stream portion of Clip1 (Clip AV stream file) 
preZs to RSP-N e^it f rom_previous_Clip will be arranged in a continuous area not less than half fragment, ■n.e da^a 
Tenq h onhe Bridge-Cl^ AV stream must be selected so that the data will be arranged .n the continuous area not less 
hanl« SLgmen^ RSPN enter_to_current_Clip must be selected so that the stream portion of Clip2 (C p AV stream 
Si subsequent to RSPN'enter to_current_Clip will be arranged in a continuous area not less than half figment 
MIT? S way of explarning data allocation limitations in case of seamless connection not employing Bndge-CUp 
bv referring to Fig.95. Sie seLless connection must be made so as to guarantee continuous data supply by the fHe 
sjs^em ™s must be realized by armnging the last portion of the CHp1 (Clip AV stream file) and the first portion of the 
30 ciip2 (Clip AV Stream file) SO that the provisions on data allocation will be met. ♦,^=»th«n«no 
r0318 ?he last stream portion of Clip1 (Clip AV stream file) must be arranged in a continuous area not less than one 
h^f fragn;ent -S;e first stream portion of Clip2 (Clip AV stream file) must be arranged in a continuous area not less 

^5319T^^12e"'w^ere digital AV signals each having a predetenriined bit rate are fragmented and recorded on a 
35 SsctoassureTtt^erecorLddigtt^^^^^ 

bit rate, the size of one continuous recording area must satisfy the following condition: 
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S*8 / (S*8/Rud + Ts) >= Rmax 



where 



S- minimum size of one continuous recording area [Byte] 

Ts: access time of full stroke from one recording area to next recording area [second] 
45 Rud: bit rate for reading out from recording medium [bit/second] 

Rmax: bit rate of AV stream [biVsecond]. 

[0320} That is, the data must be arranged so that S byte or more data in the AV stream may be recorded continuously 

so roVzi^l The data must be arranged so that the size of the half fragment may be S byte or more. 

0322 Next DVR-STD is explained. This DVR-STD is a conceptual model for modeling the decoding processing in 
the aeneraWon and verification of the DVR MPEG 2 transport stream. The DVR-STD is also a conceptual model for 
rJodrngte d^d^g processing in the generation and verification of the AV stream referenced by two Playltems 
<iPamlesslv connected to each Other as described above. ... * n^Y/o 

55 f0323r% 96 s^ws a DVR-STD model. The model shown in Fig.96 includes, as a constituent element, a DVR 
M?EG 2 transport stream player model. The notation of n. Tbn. Mbn. Ebn. Tbsys. Bsys. Rxn. Rbxn. Rxsys. On. Dsys. 
On and pS is°he s^^ as tL defined in T-STD of ISO/lEC 1 381 8-1 , wherein n is an index number of an elementary 
stream and TBn is a transport buffer of the elementary stream n. 
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[0324] MBn is a multiplexing buffer of the elementary stream n and exists only for the video stream. EBn is an 
elementary stream buffer of the elementary stream n and is present only for the video stream. TBsys is a main buffer 
in a system target decoder for the system information for a program being decoded. Rxn is a transmission rate with 
which data is removed from TBn. Rbxn is a transmission rate with which the PES packet payload is removed from MBn 
5 and is present only for a video stream. 

[0325] Rxsys is a transmission rate with which data is removed from TBsys. On is a decoder of the elementary stream 
n. Dsys is a decoder pertinent to the system infomnatron of a program being decoded. On is a re-ordering buffer of the 
video stream n. Pn(k) is a number k presentation unit of the elementary stream. 

[0326] The decoding process for DVR-STD is explained. During the time a sole DVR MPEG 2 transport stream is 
10 being reproduced, the timing of inputting the transport packet to TBI , TBn or TBsys is determined by arrivaLtime_stamp 
of the source packet. The prescriptions for the buffering operation of TB1 , MB1 , EB1 , TBn Bn, TBsys and Bsys are the 
same as those of the T-STD provided for in ISO/IEC 13818-1 , while the prescriptions for the deciding and display 
operations are also the same as the T-STD provided for in ISO/IEC 13818-1 . 

[0327] The decoding process during the time the seamlessly connected PlayLists are being reproduced is now ex- 
15 plained. Here, the reproduction of two AV streams referenced by the seamlessly connected Playltems is explained. In 
the following explanation, the reproduction of TS1 and TS2, shown for example in Fig. 88, is explained. TS1 and TS2 
are a previous stream and a current stream, respectively. 

[0328] Fig. 97 shows a timing chart for inputting, decoding and display of transport packets when transferring from 
a given AV stream (TS1 ) to the next AV stream seamlessly connected thereto (TS2). During transfer from a preset AV 
20 stream (TS1 ) to the next AV stream seamlessly connected thereto (TS2), the time axis of the arrival time base of TS2 
is not the same as the time axis of the arrival time base of TS1 (indicated by ATC1 in Fig.97). 

[0329] Moreover, the time axis of the system time base of TS2 (indicated by ATC1 in Fig. 97) is not the same as the 
time axis of the system time base of TBI (indicated by STG1 in Fig.97). The video display is required to be continuous 
seamlessly, however, there may be overiap in the display tine of the presentation units. 
25 [0330] The input timing to DVR-STD is explained. During the time until time T1 , that is until the inputting of the last 
video packet to the TBI of DVR-STD, the input timing to the buffers of TB1 , TBn or TBsys of DVR-STD Is determined 
by arrival_time_stamp of the arrival time base of TS1 . 

[0331] The remaining packets of TS1 must be input to buffers of TBn or to TBsys of DVR-STD at a bitrate of 
TS_recording_rate (TS1). The TS_recording_rate (TS1) is the value of TS_recording_rate defined In Cliplnfo() corre- 
30 spending to Clip1 . The time the last byte of TS1 is input to the buffer is the time T2. So, during the time between time 
T1 and time T2, arrivaLtime_stamp of the source packet is discounted. 

[0332] If N1 is the number of bytes of the transport packet of TS1 next following the last video packet of TS1 , the 
time DTI from time T1 until time T2 is the time necessary for N1 bytes to be input completely at a bitrate of 
TS_recording_rate (TS1), and is calculated In accordance with the following equation: 

35 

DTI = T2 - T1 = N1/TS_recording_rate. 

[0333] During the time from time T1 until time T2 (TS1 ), both the values of RXn and RXsys are changed to the value 
40 of TS-recording_rate (TS1 ). Except this rule, the buffering operation is the same as that of T-STD. 

[0334] At time T2, the arrival time clock counter is reset to the value of arrlval_time_stamp of the first source packet 
of TS2. The Input timing to the buffer of TBI , TBn or TBsys of DVR-STD is determined by arrivaLtime_stamp of the 
source packet of TB2. Both RXn and RXsys are changed to values defined in T-STD. 

[0335] By way of explaining additional audio buffering and system data buffering, the audio decoder and the system 
45 decoder need to have an additional buffering amount (data amount equivalent to one second) in addition to the buffer 
amount defined in T-STD in order to allow input data of a domain from time T1 to time T2. 

[0336] By way of explaining the video presentation timing, the display on the video presentation unit must be con- 
tinuous, that is devoid of gaps, through junction point. It is noted that STG1 is the time axis of the system time base of 
TS1 (Indicated as STC1 in Flg.9), while STC2 is the time axis of the system time base of TS2 (shown at STC2 in Fig. 
50 97; con-ectly, STC2 begins at time the first PGR of TS2 has been Input to the T-STD). 

[0337] The offset between STG1 and STG2 is determined as follows: the PTS1 end is the PTS on STC1 corresponding 
to the last video presentation unit of TS2. PTS2start is PTS on STG2 corresponding to the first video presentation unit 
of TS2 and Tpp Is the display time period of the last video presentation unit of TS1 , the offset STG_delta between two 
system time bases is calculated In accordance with the following equation: 

55 

STG.della = PTSIend + Tpp - PTS2start. 
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[0338] By way of explanation of the audio presentation timing, there may be overlap in the display timing of the audio 
presentation unit, with the overlap being less than 0 to 2 audio frames (see "audio overlap" shown in Fig.97). The 
indication as to which of audio samples is to be selected and re-synchronization of the display of the audio presentation 
unit to the corrected time base at back of the junction point are set on the player 
5 [0339] By way of explaining the system time clock of DVR-STD, the last audio presentation unit of TS1 is displayed 
at time T5. The system time clock may be overlapped between time T2 and time T5. During this time domain, the 
DVR-STD switches the system time clocks between the value of the old time base (STC1) and the value of the new 
time base (STC2). The value of STC2 may be calculated in accordance with the following equation: 

STC2 = STC1 - STC.delta. 

[0340] The buffering continuity is explained. STC11 video_end is the value of STC on the system time base STC2 
when the first byte of the first video packet reaches TB1 of DVR-STD. STC22video_start is the value of STC on the 
15 system time base STC2 when the first byte of the first video packet reaches TB1 of DVR-STD. STC21 video_end Is 
the value of STC11video_end calculated as the value on STC2 of the system time base STC2. STC21video_end is 
calculated in accordance with the following equation: 

^ STC21 video_end = STC1 1 video_end - STC_delta. 

[0341] In order to obey DVR-STD, the following two conditions must be met: First, the arrival timing of the first video 
packet of TS2 at TB1 must satisfy the following inequality: 

25 

STC22video_start > STC21 video_end + AT1 . 

[0342] If it is necessary to re-encode and/or multiplex the partial stream of Clip1 and/or Clip2, in such a manner that 
the above inequality will be satisfied, this re-encoding or multiplexing is performed as appropriate. 
30 [0343] Second, the inputting of the video packet from TS1 followed by the inputting of the video packet from TS2 on 
the time axis of the system time base, mapped from STC1 and STC2 on the same time axis, must not overflow or 
underflow the video buffer. 

[0344] If the above syntax, data structure and the rules are used as basis, the contents of data recorded on the 
recording medium or the reproduction information can be managed properly to enable the user to confirm the contents 
35 of data recorded on the recording medium at the time of reproduction or to reproduce desired data extremely readily. 
[0345] In the above-described embodiment, the MPEG 2 transport stream is taken as an example of the multiplexed 
stream. This, however, is merely exemplary, such that the MPEG 2 program stream DSS or the transport stream used 
in the DirecTV Service (trade mark) of USA may also be used as the multiplexed stream. 

[0346] Fig. 98 shows a modification of BridgeSequencelnfo(). The difference from the BridgeSequencelnfoQ of Fig. 

40 38 is that it contains only Bridge_Clip_lnfonnation_file_name. 

[0347] Fig.99 illustrates Bridge^Clip when two Playltems are seamlessly connected in case of using the syntax of 
BridgeSequencelnfoO of Fig. 98. RSPN_exit_from_previous_Clip is the source packet number of the source packet on 
the Clip AV stream referenced by the previous Playltem. Next to this source packet is connected the first source packet 
of the Bridge_Clip AV stream file. 

45 [0348] RSPN_enter_to_current__Clip is the number of the source packet on the Clip AV stream referenced by the 
current Playltem. Ahead of this source packet is connected the last source packet of the Bridge-Clip AV stream file 
referenced by the current Playltem. In the Bridge-Clip AV stream, shown in Fig.99, SPN_ATC_start indicates the source 
packet number of the source packet in the Bridge-Clip AV stream file at which commences the time axis of new anrival 
time base. 

50 [0349] The Bridge-Clip AV stream file has a sole arrival time base discontinuous point. The second SPN_ATC_start 
in the drawings has the same meaning as that of the RSPN_arrivaLtime_discontinuity in Fig.37. 
[0350] If the syntax of BridgeSequencelnfoO of ng.98 Is used, RSPN_exit_from_previous_Clip and 
RSPN_enter_to_current_Clip are stored in the Clip Infonmation file corresponding to the Bridge-Clip AV stream file. 
SPN_ATC_start is also stored in the Clip Information file. 

55 [0351] Fig. 100 shows the syntax of the Clip Information file when the BridgeSequencelnfo is of the syntax of Fig.98. 
Sequencelnfo_start_address indicates the leading address of Sequencelnfo(), in terms of the number of relative bytes 
from the leading byte of the Clip Information file as a unit. The number of relative bytes is counted from 0. 
[0352] Flg.101 showsthesyntaxof Cliplnfo()of the Clip Information file of Fig.100. Clip_stream_type indicates wheth- 
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er the AV stream file of the Clip is the Clip AV stream file or the Bridge-Clip AV stream file. If the Clip_stream_type 
indicates the Bridge-Clip AV stream file, the next syntax field follows. 

[0353] Previous_Clip_lnfomiation_file_name indicates the Clip Information file name connected ahead of the 
Bridge-Clip AV stream file. RSPN_exit_from_previous_Clip is the source packet number of the source packet on the 
Clip AV stream file indicated by previous_Clip_lnfonnation_file_name. Next to this source packet is connected the first 
source packet of the Bridge-Clip AV stream file. This source packet number is counted as from the first source packet 
of the Clip AV stream file, with 0 as an initial value. 

[0354] Cun-ent_Clip_lnfonnation_file_name indicates the Clip Informatton file name of the Clip connected at back of 
the Bridge-Clip AV stream file. RSPN_enter_to_current_Clip is the source packet number of the source packet on the 
Clip AV stream file indicated by the current_Clip_lnfomnation_flle_name. Ahead of this source packet is connected the 
last source packet of the Bridge-Clip AV stream file. This source packet number is the is counted as from the first 
source packet of the Clip with the AV stream file with 0 as an initial value. , ^. 

[0355] Fig 102 indicates the syntax of the Sequencelnfo() of the Clip Information file of Fig.100. 
Num of_ATC_sequence indicates the number of the ATC.sequence in the AV stream file. ATC_sequence is a source 
packet sequence not containing discontinuous points of the arrival time base. In the case of Bridge-Clip, this value is 2 _ 
[03561 SPN_ATC_start[atcJd] indicates an address at which commences the arrival time base indicated by atc_id 
on the AV stream file. SPN_ATC_start(atc_ld] is of a size based on the source packet number as unit and is counted 
as from the first source packet of the AV stream file with 0 as an inltlal value. 

[03571 Figs 1 03A and 1 03B illustrate database change in case stream data of the Clip AV stream file referenced by 
Bridge-Sequence is partially erased. It is assumed that, as indicated by "Before Editing" in Fig.103A, Clip1 and Clip2 
are interconnected by Bridge-Clip, with RSPN_exit_from_previous_Clip = X and RSPN_enter_to_current_Clip = Y. 
10358] It is assumed that a stream data portion of Z1 source packets of Clip! . shown shaded, and a stream data 
portion of Z1 source packets of Clip2, likewise shown shaded, are to be erased. As a result, 
RSPN_exit_from_previous_Clip becomes equal to X- Z1 and RSPN_enter_to_current_Clip becomes equal to Y-Z2. 
25 by way of value changing, as indicated by "After Editing" in Fig.1 03B. 

[0359] By changing the syntax of the database pertinent to BridgeSequence as shown in Figs.98 and 1 01 , the infor- 
mation pertinent to the source packet number indicating a data address In the AV stream (a field commencing from 
RSPN in the database syntax) is depleted from the layer of the PlayLlst. such that the totality of the inf omiation on the 
source packet number is stated in the Clip layer. 
30 [0360] In this case, if it is necessary to change the value of the data address in the AV stream, as when data of the 
AV stream file has been partially erased, it is only sufficient if measly the Clip Infomiation file is supervised as data, 
thus advantageously facilitating database management. 

[03611 Fiq 1 04 is a flowchart illustrating the preparation of the RealPlayList. Reference is had to the block diagram 
of Fig 1 showing the recording and/or reproducing apparatus 1 . At step S10, a controller 23 records a Clip AV stream. 
35 At step S11 the controller 23 fomis PlayList() made up of Play Items covering the totality of the possible playback range 
of the above Clip. If there is STC discontinuous point in the Clip, and PlayListQ is made up of two or more Playttems, 
the connection_conditlon between the Playltems is also determined. 

[03621 At step S12 the controller 23 forms UlApplnfoPlayListQ. At step S13, the controller 23 fonns PlayListMark. 
At step 14. the controller 23 forms MakersPrivateData. At step SI 5. the controller 23 records a Real PlayList file. In 

40 this manner one Real PlayList file is created each time a Clip AV stream file is newly recorded. 

[0363] Fig 1 05 is a flowchart for illustrating the fonnulation of a Virtual PlayList having a bridge sequence. At step 
S20 reproduction of one Real PlayList recorded on the disc is specified through a user interface. From the reproduction 
range of the Real PlayList. the reproduction domain specified by IN and OUT points is specified through user interface. 
[0364] At step S21 the controller 23 verifies whether or not the operation of specifying the reproduction range by 

45 the user has been finished in its entirety. If it is verified that the specifying operation has been finished, the controller 
23 proceeds to step S22 and. if othenwise. the controller 23 reverts to step S20 to repeat the subsequent processing. 
[0365] At step S22 the user determines the connection condition between two continuously reproduced Playltems 
(connection_condition), through user interface, or the controller 23 determines the connection condition. At step S23 
the controller 23 fornis a bridge sequence for the seamlessly connected Playltems. At step S54. tghe controller 23 

50 fomis and records the Virtual PlayList file. 

[0366] Fig 106 is a flowchart for illustrating the detailed processing at step S23. At step S31 . the controller 23 re- 
encodes and re-multiplexes an AV stream on the OUT point side of the Playltem displayed on the temporally forward 
side. At step S32, the controller 23 re-encodes and re-multiplexes the AV stream on the IN point side of the Playltem 
represented next to the Playltem. . . ^ 

55 [0367] At step S33. the controller 23 determines the value of the RSPN_exit_from_previous_Clip such as to satisfy 
the data allocation condition for continuous data supply. That is. RSPN_exit_from_previous_Clip must be selected so 
that the stream portion of the Clip AV stream file previous to RSPN_exit_from_previous_Clip will be recorded in a 
continuous area not less than the aforementioned half fragment on the recording medium (see Figs.91 and 94). 
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,03es, A, »ep S.4. ..e con,ro„e, .3 «.^lne. ... ..iu, --^Jl^^^X S.'^S'S'iT. 

103741 At step S45. the controller 23 reads out data of the Jtrea ^^^^ temporally previous 

above entry point to send the so read ^^^^T;^^^^^^^^ pLious Playltem and the 

'::;::'^X^T:^^:^T:^^^^^ « the%.ay-te.s are interconnected sea..ess,y. the AV 

stream is decoded based on the DVR-STD "['^^^f .^^ „ 3^^^ the display as from the picture of the 

step S49. the controller 23 venues wnemer ui nui i ^ j controller 23 proceeds to - 

it is verified that the picture currently displayed is P'^^^^^^^^^^^ ' 

step S50 to display the picture, after which the ^^"^'•^''^f J^^^^^V^^^^^^ time, the controller 

10376, If it is -tied ^t step S49 tha . " 

23 proceeds to step S51 where the controller 23 verifies wneiner or ^ at the 

^TB] Based on Ih. .b<,.«.aesenbM syntax dal. J^J^ii^erK mmaied 

201 of the personal computer executes a vaneiy oi pr«. ^J^j'. _„ suitably stored data or programs 

ROM (read-only memory) 202. In a RAM (random-access ^;;"°^> ^OS^the e s^^^^^^ ^^^^^^ 

necessary for the CPU 201 to execute various ^''>^^^^l°^'^^^'^J^^^^^ unit 206 to the CPU 

ToiTt^^^nTutS^^^^^^ 

;?-r°^o^heinpu.o^^^^^^^^^^^^^ 

disc 222. a magneto-optical disc 223 TpSe medium distributed for furnishing the program to 

rul.raZor rC™^^^^ - p.gram thereon, inclus.e of a floppy 
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of a ROM 202 carrying a program and a memory 20b, lurnisnea lo uic u©ci a 

mliT' in the present specification, the steps of the program furnished by the medium include not °"|y f^^^^ 
!ogiS prodiing fn accordance with the sequence indicated, but also the process.ng perfomied not chronologically 

?o;ii]'Cdlrar"'?le specmcation. the system means an entire apparatus comprised of plural component de- 



vices. 

Industrial Applicability 



30 maintain continuity in separately recorded AV streams. 



Claims 

35 1 . An information processing apparatus comprising: 

and ohI. inS^Mior on .he addres. o( . source padke. of »ld second AV stream at a t.m.rg »t =««ch.ng cl 

rr:er,o^'r^4"s=™Trr:rasr.^^^ 

erating means. 

third AV stream are continuous to each other. 
53 3 The infom^atlon processing apparatus according to claim 2 wherein a sole discontinuous point exists In the anival 
time stamp of the source packet in said third AV stream. 
4. The infom,atlon processing apparatus according to claim 2 wherein said address Is detem^ined so that a data 
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portion of the AV stream previous to a source pacl<et specified by the information on the address of the source 
packet of said first AV stream contained in said address infomiation generated by said generating means will be 
located in a continuous area of not less than a preset size on a recording medium. 

5 5. The information processing apparatus according to claim 2 wherein said address is detemnined so that a data 
portion of the AV stream subsequent to a source packet specified by the infomiation on the address of the source 
packet of said second AV stream contained in said address infonnation generated by said generating means will 
be located in a continuous area of not less than a preset size on a recording medium. 

10 6. The information processing apparatus according to claim 2 wherein said third AV stream is generated so that said 
third AV stream will be located in a continuous area of not less than a preset size on said recording medium. 



7. An Information generating method comprising: 

IS a step of generating, in case continuous reproduction from a first AV stream to a second AV stream is com- 

manded, a third AV stream made up of a preset portion of said first AV stream and a preset portion of said 
second AV stream, said third AV stream being reproduced when reproduction is switched from said first AV 
stream to said second AV stream, and 

a step of generating the address information, as the infomnation pertinent to said third AV stream, said address 
20 information being made up of the infonnation on an address of a source packet of said first AV stream at a 

timing of switching of reproduction from said first AV stream to said third AV stream, and of the infomnation on 
the address of a source packet of said second AV stream at a timing of switching of reproduction from said 
third AV stream to said second AV stream. 

25 8. A recording medium having recorded thereon a computer-readable program, said program comprising: 

a step of generating, in case continuous reproduction from a first AV stream to a second AV stream is com- 
manded, a third AV stream made up of a preset portion of said first AV stream and a preset portion of said 
second AV stream, said third AV stream being reproduced when reproduction is switched from said first AV 

30 stream to said second AV stream, and 

a step of generating the address information, as the infonnation pertinent to said third AV stream, said address 
information being made up of the infonnation on an address of a source packet of said first AV stream at a 
timing of switching of reproduction from said first AV stream to said third AV stream, and of the infonnation on 
the address of a source packet of said second AV stream at a timing of switching of reproduction from said 

35 third AV stream to said second AV stream. 

9. A program for having a computer execute a program, said program comprising: 

a step of generating, in case continuous reproduction from a first AV stream to a second AV stream is com- 
40 manded, a third AV stream made up of a preset portion of said first AV stream and a preset portion of said 

second AV stream, said third AV stream being reproduced when reproduction is switched from said first AV 
stream to said second AV stream, and 

a step of generating the address infomnation, as the infonnation pertinent to said third AV stream, said address 
infonnation being made up of the infonnation on an address of a source packet of said first AV stream at a 
45 timing of switching of reproduction from said first AV stream to said third AV stream, and of the information on 

the address of a source packet of said second AV stream at a timing of switching of reproduction from said 
third AV stream to said second AV stream. 



10. An infonnation processing apparatus comprising: 

50 

first readout means for reading out a first AV stream, a second AV stream or a third AV stream from a recording 
medium; 

second readout means for reading out. as the infonnation pertinent to said third AV stream, the infonnation 
on an address of a source packet of said first AV stream at a timing of switching of reproduction from said first 
55 AV stream to said third AV stream, and of the infonnation on the address of a source packet of said second 

AV stream at a timing of switching of reproduction from said third AV stream to said second AV stream; and 
reproducing means for pert onning reproduction as reproduction is switched from said first AV stream read out 
by said first readout means to said third AV stream and from said third AV stream to said second AV stream. 
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based on the information pertinent to said third AV stream read out by said second readout means. 

11. An information processing method comprising: 

5 a first readout controlling step of reading out a first AV stream, a second AV stream or a third AV stream from 

a recording medium; 

a second readout controlling step of reading out. as the information pertinent to said third AV stream, the 
infonnation on an address of a source packet of said first AV stream at a timing of switching of reproduction 
from said first AV stream to said third AV stream, and of the information on the address of a source packet of 
10 said second AV stream at a timing of switching of reproduction from said third AV stream to said second AV 

stream; and 

a reproducing step of performing reproduction as reproduction is switched from said first AV stream read out 
by said first readout means to said third AV stream and from said third AV stream to said second AV stream, 
based on the information pertinent to said third AV stream read out by said second readout means. 



IS 



12. A recording medium having recorded thereon a computer-readable program, said program comprising: 



a first readout controlling step of reading out a first AV stream, a second AV stream or a third AV stream from 

a recording medium; 

20 a second readout controlling step of reading out, as the infonnation pertinent to said third AV stream, the 

information on an address of a source packet of said first AV stream at a timing of switching of reproduction 
from said first AV stream to said third AV stream, and of the information on the address of a source packet of 
said second AV stream at a timing of switching of reproduction from said third AV stream to said second AV 
stream; and 

25 a reproducing step of perfonning reproduction as reproduction is switched from said first AV stream read out 

by said first readout means to said third AV stream and from said third AV stream to said second AV stream, 
based on the information pertinent to said third AV stream read out by said second readout means. 

13. A program for having a computer execute a program, said program comprising: 

30 

a first readout controlling step of reading out a first AV stream, a second AV stream or a third AV stream from 
a recording medium; 

a second readout controlling step of reading out, as the Information pertinent to said third AV stream, the 
information on an address of a source packet of said first AV stream at a timing of switching of reproduction 
35 from said first AV stream to said third AV stream, and of the information on the address of a source packet of 

said second AV stream at a timing of switching of reproduction from said third AV stream to said second AV 
stream; and 

a reproducing step of perfonning reproduction as reproduction is switched from said first AV stream read out 
by said first readout means to said third AV stream and from said third AV stream to said second AV stream, 
40 based on the Information pertinent to said third AV stream read out by said second readout means. 

14. A recording medium having recorded thereon the address information comprising, in case continuous reproduction 
from a first AV stream to a second AV stream Is commanded, a third AV stream made up of a preset portion of 
said first AV stream and a preset portion of said second AV stream, said third AV stream being reproduced when 

45 reproduction is switched from said first AV stream to said second AV stream, and the address information, as the 

infonnation pertinent to said third AV stream, said address infonnation being made up of the information on an 
address of a source packet of said first AV stream at a timing of switching of reproduction from said first AV stream 
to said third AV stream, and of the information on the address of a source packet of said second AV stream at a 
timing of switching of reproduction from said third AV stream to said second AV stream. 

50 
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USER SPECIFIES MARK POINT OF REPLAY 
START POINT 
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IF CPI_type IS EP.mapTYPE. ACQUIRE MARK 
PTS AND Playltem_id IT BELONGS. IF CPI.type IS 
TU_map TYPE, ACQUIRE MARK ATS 

(Arrival Hme Stamp) 
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IF CPI_type IS EP.mapTYPE, ACQUIRE 
STC-sequence-id OF AV STERAM REFERENCED 
BY Playltem SPECIFIED BY Playltemjd 
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IF CPI_type IS EP_mapTYPE. INPUTTO 
DECODER AV STREAM BASED ON ABOVE 
STC-sequence-id AND MARK PTS. IF CPI_type 
iSTU.mapTYPE, INPUTTO DECODER AV 
STREAM BASED ON MARK ATS 
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IF CPI_type IS EP_mapTYPE. START DISPLAY 
FROM PICTURE OF MARK POINT PTS. IF 
CPLtype IS TU_mapTYPE, START DISPLAY FROM 
PICTURE SUBSEQUENT TO MARK POINT ATS. 
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